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In  contemporary  fliynt  simulators,  catnoue  ray  tuue  ^ukT  )  uisplays 
are  typically  useu  to  display  fliynt  information  to  tne 
instructor /operator.  However,  no  one  Knows  tne  uest  formats  for 
displaying  tnis  data.  designs  are  usually  uaseu  on  an  engine*  r's  uest 
yuess  in  liynt  of  previous  experience.  As  a  result,  uisplays  are  often 
difficult  to  use,  ano  too  muon  of  tne  instructor's  attention  is  consumeu 
in  merely  seareniny  for  neeueu  information.  Tne  Air  force  nas  iniciateu 
a  series  of  studies  aimeu  at  systematising  tne  oesiyn  of  tne 
instructor/operator  station  \iuS)  anu  improving  tne  utiLity  of  assuciateu 
uisplays.  Tne  purpose  of  tnis  particular  effort  was  to  develop 
teonniques  for  oojeptively  evaloatiny  alternative  formats  uy  assessing 
tneir  impact  on  tne  instructor's  performance. 


Approacn 


Tne  approacn  was  to  pevelop  a  way  to  measure  tne  instructor's 
performance  on  selectej  tasKs.  oy  tnis  means,  tne  effects  of  alternative 
uispiay  formats  coulu  ue  assessed  uy  Having  suujects  perform  instructor 
tusKS  using  tne  different  uispiay a  anu  comparing  tne  resulting 
pe  r  f  p  r illanpe  ,nea  sores. 


Tne  specific  tdSe  seiecteu  was  monitoring  trie  pilot’s  performance, 
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i.e.,  ouserviny  dnu  assimilating  tne  current  fliynt  conditions  unu 
progress  by  watching  tne  display.  we  ueveluueu  u  uencnmarK  performance 
monitoring  tas>s  that  we  cuulu  repeat  in  d.n  experimental  setting.  tu  uo 
this,  we  usej  several  prereeurueu  fliynt  segments  t.o  urive  tile  display  to 
pe  evaluated.  Fne  subject  was  requireu  tu  carefully  observe  tne 
oisplay.  At  tne  conclusion  of  eacn  segment,  «e  cueeu  specific  questions 
of  tne  subject  tu  test  tne  observations  ne  „jj  capable  of  .iiaKiny  with 
tnat  display.  We  reasoned  tnat  tne  success  with  wnien  a  soaject  is  able 
to  inaKe  consistently  accurate  ouservdt ions  is  indication  of  tne 
display's  value  in  supporting  tne  perturbance  monitoring  tasc. 

Specifics 


We  recorueu  several  fliynts  of  eacn  of  five  uastc  maneovers:  cl imp, 
pescent,  level  torn,  climulny  turn,  anu  uescenuiny  turn,  far  eacn 
maneuver,  we  uesig'ieu  questions  to  assess  tne  accuracy  anu 
comprehensiveness  of  the  suujects’  ouservations  curing  tne  replay  of  tne 
segment.  These  questions  concerned  maximum  anu  minimum  values  of  - %ey 
variaules  ano  tneir  values  at  strategic  points  in  tile  maneuver.  Tne 
questions  were  Cdtegorisep  into  four  types  to  ui s t inguisil  wiietner  tiiey 
pertaineu  to  ranges  or  exact  values  o*’  variauies  anu  wiietner  tney 
concerned  observations  over  a  span  ot  time  Lir  at  one  specific  lime  in  tne 
maneuver . 

Suujects  consisteu  ot  twenty  u-1j>U  anu  u-IhI  pilots  frum  mcunuro  Aro, 
Wasnington.  Tney  were  not  toiu  wnat  maneuver  tney  were  ^uind  tu 
ouserve.  instead,  t.n^y  were  auvis°u  tiiat  tney  were  to  watun  tne  uisplay 
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uou  0*-  prepared  to  answer  questions  auuut  tneir  uuservations  regarding 
t n*j  valups  of"  major  variaules  during  me  t'liynt.  using  a  ranuuinizeu 
design,  wp  tpstpo  eacn  suoject  using  eacn  of  two  alternative  displays: 
uigital  readouts  anj  repeat  instruments.  rliynt  segments  were  randomly 
selected  ana  replayed  on  tne  display  oeiny  tested.  After  eacn  segment, 
tne  experimenter  asKep  tne  test  questions  orally  ana  recorded  tne 
responses. 


Results  of  interest  concern  potn  tne  utility  of  tne  overall  inetnuu 
anj  tne  particular  comparison  of  tne  two  displays  tested,  we  concluded 
tout  tne  inetnoa  is  extremely  promising  for  evaidating  displays,  uur 
experience  suggests  some  cnanyes  neep  to  ue  made  in  tne  particular 
questions  asKpd  a-no  tne  measurement  metnou  useu.  but  tne  concept  of  tne 
pencnmaix  tasx  approacn  nas  neen  clearly  uemunstrateu  as  wortnwniie. 

Altnougn  tne  intent,  was  to  evaluate  tne  inetnouulogy  ratner  titan 
acnieve  a  meaningful  comparison  of  displays,  it  is  still  of  interest  to 
see  wnat  tiie  tests  revealep.  we  founu  tiiat  questions  regaruing  pitcn, 
airspeed,  anp  vertical  velocity  were  answered  more  accurately  witn  tne 
repeater  display  tnan  witn  tne  digital  readout  display-  tor  qdestiuns  on 
roll,  neaoiny  ano  altitude,  tnere  was  no  significant  difference  uetween 
foe  two  displays. 

for  pitcn,  uotn  tne  type  pf  maneuver  ano  type  pt  questions  produced 
significant  effects,  differences  jetween  tne  two  displays  uecurreu  only 
in  tne  elimu  and  climuing  turn.  Manejver  type  also  pruuuceu  a 
significant  effect  on  airspeed  questions.  As  miynt  ue  expected,  errors 
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were  smallest  lor  tne  level  turn,  for  neuuing,  just  toe  opposite  was 
true,  i.e.,  errors  were  yreater  for  tne  level  turn  loan  tor  any  utner 
maneuver  type. 

ine  type  of  question  proouceu  significant  effects  for  five  of  tne  six 
variaoles,  airspeeu  ceing  tne  only  exception,  jn  roll,  for  example, 
questions  on  tne  extremes  of  roll  curing  tne  segment  nao  tne  iaryest 
errors,  anu  questions  asxiny  for  a  single  value  of  roll  at  a  specific 
point  nau  tne  smallest  errors.  Utner  interesting  results  were  fuunq  fur 
tne  remaining  variaoles,  out  tnere  is  no  way  to  rationalise  all  tne 
findings  witnout  additional  study. 

Tnere  was  no  strong  correlation  uetwee.n  elapses  time  from  event  to 
question  anj  tne  magnitude  of  errors,  nowcver,  tnis  is  an  a  conclusive 
result  oecause  tne  stuuy  was  nut  uesigneu  to  treat  elapses  tinie 
systematically.  Tnis  snouid  oe  stuoieu  furtner  uefore  extensive  use  is 
made  of  tne  metnod. 

In  conclusion,  tne  uencnmarx  tasK  approacn  appears  to  ue  an  excellent 
way  Lu  evaluate  tne  comparative  effectiveness  of  displays.  Audition*! 
resejrcn  needs  to  up  performeo  on  tne  question  set,  tne  particular 
measures  uses,  anj  tne  possiule  effects  of  memory  on  tasx  performance. 
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T'ns  su;d\  ws  conducted  under  Proi^ct  PH*,  "Sii 'ul at.nr  Todininue 
f('.r  'irnvv  Tr.inim-,"  Task  oil/1-?),  "rdvancod  f.ir.ul nt.rr  ronc°nt.s." 

"e .  ra*ric/n  i'»  no-i  wav  Pro  met  Pciontist  and  “r.  Patrick  Price  was 

'  c.i'V'.pi sp.  "r,  ‘!<~>o  1  Sc,'vnrf7  was  \:vv'f.  unit  and  r.on tract  nnaeor 
fnr  V';;  Aii  !"or 

TV  ctnU‘al.1'''  conducted.  tv.'o  distinct  studios  coverine  tins  work. 
T:,o  first  study  is  -locurontod  in  ■'\r>,'otv.!ix  r-,  and  +!k?  second  stud', 
eras  M  tuti  s  V-i'  Pull  >'*"  tPo  i  <  i n  text  of  tV  report.  TV  t'-T  sfudv 
r.Tv.rli,  vary  reworked  slic’-tl'-'  !>y  'is.  knooo  ami  'V.  tcimort::  of 
•A  T!  ;'l.  for  or  .>  mi  rat  Vo  ft  s  ’  ■  i '  ■  coi  .oro'ionsi  vo  reoert . 
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It troductirn 


The  Air  Force  needs  an  clioctive  uchr.inuc  for  evaluating  displays  to  be 
used  at  the  instructor/onerater  station  (WS) .  The  custom.-e /•  overlay  node 
has  been  the  use  of  ronuati  r  instrument:-,  disnlavs  that,  for  the  most  nart, 
'’;;nl icatc  those  use'1  ir  the  cocknit.  Alternative  modes  of  i nfornation 
(jisnlav  may  be  more  effect ivf  ,  hut  there  must  be  snr'e  ways  of  estah1, i sh¬ 
in'1  relative  effectiveness  before  a  decision  to  select,  one  can  he  made 
in  tell  i'-cntlv.  fore  standard  test  is  required  for  determining  the  rela¬ 
tive  effectiveness  <-f  disninv  methods. 

7 1  c  es  tah-1  i  shient  of  uuidelines  for  desiurinn  ard  cy. al  i  at  i  no  I  OS  displays 
casr-e*  he  acccr o i i sued  by  reference  tc  nertinent  literature  because  the 
relevant  data  on  not  exist.  This  is  often  the  situation  when  the  speci¬ 
fic  ’Moris  and  rocoir-ondatior1  c  nl  v  tc  i  env  -faceted  ov-nle.:  activities 
such  as  the  v.ork  of  the  instructor  r  i  lot  (IP). 

The  goal  of  this  study  is  to  devise  a  i  t  ■‘l  ed  for  delerminino  IDS  display 
effectiveness  and  for  cevoi o"i  in  guidelines  for  disnlf.v  enoineeriro  ir 
corfen 'ance  with  hui  ar  skills  and  limitations  The  approach  is  to  select 
characteristic  monitorino  activities  of  the  instructor/onerater  (10) 
located  at  ar-  lrdi  remote  from  the  simulator  and  to  deveicr  a  benchmark 
tci  h  l.ased  on  these1  activities.  This  task  was  then  performed  \  sit.ieccs 
usinr  one  of  ti'o  alternative  disnlavs  to  be  evaluated.  Objective r 
c;uar,ti  t'.t.i  ve  l  erfermance  noash"os  or-  the  tasr  we»v  commuted  and  used  to 
mate  'inferences  about  the  utility  of  the  sisnlav  in  s'.ipuortino  the 
instructor's  monitoring  task.  Tlv  technique  was  demons tea  ted  hv  us' no  • • 
tc  evaluate  two  display  techniques :  diuital  readouts  versus  repeater 
i  ns  truwmts . 

II.  Tack 'round 

T1  is  is  the  secern,  of  two  studies  supported  by  AFt'PL  tc  novel  on  a  technique 
for  the-  oval  Uc'i' f  r,  ,4r  disnlavs  tc  be  used  at.  an  Ird.-  associated  v-ith  nilet 
trainin'-.  >p  simulators.  In  the  first  study,  the  basic  methods  were 
devoir  ’•c-d  and  oxerM:  cd  *‘i  a  preliminary  demonstration .  This  first  study 
:s  doc  in  on  ted  ir.  Anoeridi>  c,  of  this  renort.  The  results  of  the  first 
r.t  udy  simmer!  fat  the  crnceot  o*'  the  hcrichinanh  task  should  be  of  ft.  a  I  value 
in  the  pt  'rc-;i\p  i  ssesM'iont  or  IM-  display  effectiveness.  The  intent  of 
the  beoctmar1'  task  is  to  '>revi  rf  the  basis  tor  a  ouani.i  f.iti  ve  rreasutf- 
i  ir ‘ n *  rf  dim  lav  c'fectivonor.s ,  while  at  the  same  time  j»erv  i  ttino  die 
rrv  oa  rc  her  to  determine  fe  limits  of  human  abilities  rooardi  no  nercop- 
t  i or-  ar,c'  retertin  (d  visually  displayed  infornatioe.  It  should  be  directed 
'  -os  t  s  tra  i  <■  h  +  1Y  ir-  a  rd  I '»  tc  tie  activities  of  the  IP.  Or,  tlio  cither  hand, 
et  eater  <  en»ral  i  t>  rf  the  firu'inns  fnnp>  thi  tenchpiark  tasd  requires  that 
I  a  sic  hurar  abilities  bo  tanned  for  r.  wider  aoul  icat  iei.  rf  tire  rcri.its 
to  future  IT  me  rational  tosis.  It  is  a  task  whose  er.scrtig',  characteristic: 
concer  n  she rt-f-n -  recall  a!  i  1  i  ties,  whi le  beinn  constructed  inrhe  framework 
nr  f 1  i til  I.  ,:cvf(’:'i1i.)nr.r  loriteviry  lv  an  IT. 

Ir  .he  fir-.'!  stun.  (see  ■"■'nem*  1  \  >' '  ,  < testier:  were  "mo  rated  to  require 
r  sir/'le  aiiS'-eu  -  the  maximum  or  i  inimur.  indication  for  some 
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selected  flight  parameter  or  the  value  shown  at  some  identifiable  noint 
during  the  flight  segment.  In  the  second  study,  the  categories  or 
flues tions  were  treated  systematically,  with  each  of  four  question  tvnes 
represented  once  for  each  maneuver  tyne  for  each  flinht  parameter  (see 
Figure  1).  The  inclusion  of  flight  indication  ranges  throughout  the 
flight  segment  and  over  a  limited  portion  of  it  (question  types  1  and 
2)  was  made  to  represent  more  realistically  the  monitoring  requirements 
of  the  IP. 

The  first  study  used  a  "Multi -Mission  Simulator”  cocknit  analog  display 
with  a  cathode  ray  tube  digitial  display  mounted  above  the  instrument 
panel,  where  one  or  the  other  display  was  covered  during  the  presenta¬ 
tion  of  a  flight  segment.  For  the  second  study,  a  remotely  piloted 
vehicle  (-lpV)  control  panel  simulator  was  used.  The  arrangement  of 
instruments  and  positions  of  the  digital  indicators  on  the  CRT  '/ere 
the  same  in  both  studies  but  the  RPV  simulator  was  more  convenient  for 
the  subject  and  experimenter  because  of  the  quality  of  lighting  and 
wcod  table  surface  for  writing  and  leaning  on  elbows  during  the  segments. 
The  RFV  simulator  also  allowed  the  experimenter  to  be  located  closer  to 
tha  subject,  aiding  communication. 


The  four  subjects  who  served  infhe  first  study  were  drawn  from  the  Crew 
Systems  organization  of  Logistics  Systems  and  Support  in  the  Boeing 
Aerosauce  Company  and  had  quite  heterogenous  tlvinq  experiences. 

Included  was  a  young  person  with  only  40  hours  of  solo  time  ii  a  light 
general  aviation  aircraft,  as  well  as  one  subiect  whose  flvino  time  was 
moo r.i.v  in  helicopters  and  two  other  pilots  who  had  flown  a  wide  range  of 
fixed  wire  aircraft,  from  early  World  War  II  equipment  to  multi-engine 
jets. 

in  the  second  study,  the  20  pilots  serving  as  observers  in  the  study 
'■■em  all  currently  flying  either  the  C-130  or  the  C-141  aircraft.  They 
had  experience  more  directlv  relevant  lc  fir  Force  interests  than  did 
the  four  subjects  in  the  earlier  study. 

In  the  earlier  study,  each  sulject  made  30  responses,  an  with  each  of 
the  two  displays.  In  the  second  study,  each  subject  made  240  responses 
distributed  evenly  between  the  two  display  types;  thus  the  experimental 
variables  could  be  treated  more  systematically.  For  example,  the 
earlier  study  was  not  designed  to  include  qur^tmens  about  all  six  flight 
parameters  after  each  flight  segment  was  presented.  In  the  second 
study,  all  six  mere  included  each  time. 

’The  most  important  area  for  improvement  was  in  the  kinds  of  data  analy¬ 
ses  that  could  be  performed  on  the  responses.  If  was  apparent  that  the 
analysis  of  variance  (AilOVA)  was  desirable  for  what  could  be  shown  about 
interactions  among  variables,  as  well  as  main  effects.  The  larger,  more 
systematic  study  permitted  the  demonstration  of  such  interactions. 
Another  benefit  from  th '  second  study  is  the  ability  to  do  correlational 
analyses . 
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Figure  1.  Sample  categories  of  questions. 
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Much  of  the  improvement  in  the  second  study  data  analyses  was  related  to 
the  treatment  of  the  data  in  terms  of  absolute  error  instead  of  error 
tolerance  limits.  That  is.  the  difference  between  the  displayed  alti¬ 
tude,  for  example,  and  the  reported  altitude  (in  feet)  was  the  datum  to 
be  included  in  the  analysis  rather  than  a  dichotomous  scoring  technique 
of  right  vs.  wrong  based  on  an  arbitrary  division  point.  Other  flight 
parameters  were  treated  similarly. 

Another  goal  in  the  second  study  was  to  develop  a  single  measure  of 
display  effectiveness.  This  was  to  be  based  on  a  transformation  of  raw 
error  scores  into  standard  scores  which  assume  a  normal  frequency 
distribution  for  each  flight  parameter.  Standard  scores  are  in  standard 
deviation  units,  i.e.,  the  deviation  of  the  score  from  the  mean  value  is 
divided  by  the  standard  deviation.  Thus,  a  deviation  equalling  the 
standard  deviation  has  a  value  of  1.0  regardless  of  the  size  of  the  mean 
or  the  standard  deviation  in  the  original  units.  The  assumption  of  a 
normal  distribution  is  accompanied  by  an  assumption  of  equal  importance 
of  all  measures  to  be  included  in  a  composite  score  taken  as  a  figure  of 
meri t. 

The  variable  of  time  interval  between  the  occurrence  of  a  flight  indica¬ 
tion  and  the  end  of  the  flight  segment  (when  the  questions  were  presen¬ 
ted)  was  not  analyzed  in  the  earlier  study  but  it  was  included  in  the 
study  reported  here. 

In  summary,  a  number  of  changes  were  made  to  improve  the  benchmark  task 
evaluation:  the  test  content,  the  testing  environment,  the  subject 
population  from  which  the  larger  sample  of  20  subjects  was  drawn,  the 
experimental  design,  the  treatment  of  data  as  continuous  rather  than 
discrete,  the  use  of  analysis  of  variance  and  correlation  techniques, 
and  the  collection  of  more  complete  data  amenable  to  more  sophisticated 
analyses.  Of  these,  the  most  important  were  (a)  enlarging  the  test  and 
improving  the  questions,  (b)  gathering  more  data  from  a  more  qualified 
and  homogeneous  group,  and  (c)  data  analysis. 


III.  Research  Methodology 

The  results  of  these  studies  are  to  be  applied  to  the  evaluation  of  IOS 
displays  designed  for  the  monitoring  of  pilot  performance  when  the 
instructor  and  the  student  are  not  together,  as  would  be  the  case  with  a 
single-place  training  simulator.  Of  the  many  activities  a  pilot  may 
perform  during  a  mission,  e.g.,  weapon  delivery,  none  is  more  basic  than 
flight  management.  For  this  reason,  an  important  part  of  the  IP's  task 
is  to  monitor  the  student  pilot's  flight  performance. 

The  information  chosen  for  display  in  this  study  was  that  shown  in  what 
is  sometimes  called  the  "basic  T”  of  flight  instruments.  The  horizon¬ 
tally  aligned  airspeed  indicator,  attitude  indicator,  and  altimeter  are 
the  crossbar  of  the  "T",  while  the  heading  indicator  is  centered  below 
these  three  instruments.  They  are  generally  positioned  in  the  instru¬ 
ment  panel  directly  in  front  of  tne  pilot  so  that  they  are  easy  to  scan 
with  little  or  no  change  in  head  position  from  that  used  for  forward 
extra-cockpit  viewing. 
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The  display  modes  selected  for  the  validation  of  the  benchmark  task  were 
repeater  instruments  and  a  digital  presentation  on  a  CRT.  The  repeaters 
art-  analog  displays  that  require  scanning  of  a  type  different  from  that 
used  for  the  digital  reaoout.  A  well  experienced  user  of  this  kind  of 
instrument  frequently  ignores  the  numbered  dial  when  reading  the  pointer 
indications.  An  all-digital  display  cannot  be  scanned  in  the  same  way, 
it  must  be  read  by  specifically  noting  the  displayed  numbers.  These 
widely  disparate  modes  of  display  were  considered  to  be  good  candidates 
for  the  validation  of  the  benchmark  task. 

In  the  present  study  of  IOS  display  evaluation  methods,  the  basic  "T" 
configuration  mentioned  above  and  an  added  vertical  velocity  indicator 
(VVI)  were  used.  The  VVI  is  an  important  indicator  of  altitude  change 
in  that  it  permits  the  pilot  to  set  the  controls  so  that  level  flight 
or  ascent/ descent  at  a  constant  rate  is  accomplished  by  reference  to  a 
steady  state  condition  rather  than  a  uniform  change  in  altitude  indica¬ 
tion.  Furthermore,  the  VVI,  like  the  altitude  indicator 
example  of  the  type  of  analog  display  in  which  the  orientation  of  a 
pointer  or  a  line  (relative  to  a  coordinate  system  based  on  the  instru¬ 
ment  panel)  is  usually  of  more  interest  than  the  actual  numerical  value 
of  the  indication.  These  flight  parameters  are  displayed  to  the  "experi¬ 
mental  IP"  (instructor  pilot)  for  assessment  of  pilot  performance  as 
reflected  in  his  recall  of  specific  indications  occurring  during  the 
flight  segment. 

The  maneuvers  represented  on  the  display  were  of  five  different  types. 
They  encompass  the  group  of  maneuvers  which  comprise  the  tactics  of 
combat  and  weapon  delivery  as  well  as  general  aircraft  control.  The 
basic  maneuvers  are  climb,  descent,  level  turn,  climbing  turn,  and  de¬ 
scending  turn. 

Flight  segments  were  between  1  and  3  minutes  duration.  After  the 
flight  segment  had  been  presented,  the  "instructor  pilot"  was  asked  to 
report  on  such  indications  as  the  maxima  and  minima  of  flight  parameters 
or  on  indications  occurring  at  specific  places  during  the  maneuver.  In 
the  preceding  study,  the  subjects  were  asked  a  series  of  questions  which 
were  a  random  selection  of  those  questions  appropriate  to  the  flight 
segment  just  presented.  The  current  study  included  questions  from  all 
six  flight  parameters:  airspeed,  pitch  angle,  bank  angle,  altitude, 
vertical  velocity,  and  compass  heading.  Thus  all  flight  parameters  were 
represented  in  the  questions  following  the  presentation  of  each  flight 
segment  to  permit  a  greater  amount  of  comparison  between  flight  seg¬ 
ments/  maneuvers.  Appendix  C  contains  all  of  the  test  questions  along 
with  correct  responses  and  question  type  designators  (as  shown  in  Figure 
1). 

Each  experimental  subject  (pilot)  was  presented  four  examples  of  five 
maneuvers  and  asked  questions  concerning  the  flight  indications  at 
various  points  and  over  various  spans  of  time  during  these  maneuvers. 

The  questions  required  the  subjects  to  remember  extreme  values  of  speci¬ 
fied  flight  parameters  or  to  recall  a  flight  indication  which  occurred 
at  some  particular  point  in  the  flight  segment.  The  four  examples  of 
each  maneuver  allowed  the  four  types  of  questions  to  be  presented  an 


equal  number  of  times.  Recordings  of  the  maneuvers  were  made  on  magne¬ 
tic  tape.  Each  example  of  a  maneuver  was  "flown"  separately  so  that  the 
subjects  would  not  be  seeing  identical  flight  indications  over  the  four 
examples  of  a  given  flight  maneuver.  This  reduces  effects  of  familiari¬ 
zation  with  the  path  flown  and  the  corresponding  flight  indications. 

Where  such  learning  effects  occur,  unwanted  variability  tends  to  obscure 
the  experimental  effects  under  study.  Learning  does  occur  in  any  experi¬ 
ment  where  there  are  repeated  trials.  The  subject  learns  something  of 
the  approach  to  measurement  used  by  the  individual  or  group  who  designed 
the  experiment  and  of  the  nature  of  the  task  to  be  performed.  In  the 
present  study,  each  flight  segment  was  presented  twice  to  each  subject, 
once  with  traditional  analog  instruments  (called  "round  dials"  by  the 
pilots)  and  once  on  the  CRT  in  digital  format.  While  this  repetition  of 
each  flight  segment  may  have  facilitated  recall  of  the  contents  of  the 
display,  the  randomization  of  flight-segment-by-display-conditions  would 
have  minimized  any  systematic  effect  of  this  repetition  on  recall,  i.e., 
while  the  variance  may  have  been  affected  by  duplicating  a  flight  seg¬ 
ment  for  the  alternate  display,  this  effect  would  not  result  in  a  bias 
in  favor  of  one  or  another  major  variable  other  than  that  arising  from 
chance. 

The  design  of  any  study  is  generated  within  the  context  of  limitations 
of  time  and  other  resources.  In  the  present  instance,  the  major  concern 
focused  on  the  feasibility  of  the  approach,  namely  the  development  of  a 
benchmark  task  which  could  serve  as  a  standard  for  the  evaluation  of  I0S 
displays.  Maximizing  the  potential  information  derivable  from  such  a 
study  means  balancing  the  effects  that  are  to  be  observed  against  the 
potential  diminution  for  the  demonstration  of  the  effects  of  higher 
priority  variables.  For  example,  the  subjects  were  asked  to  monitor 
only  a  few  of  the  types  of  information  that  an  instructor  pilot  might 
have  at  the  IOS.  The  display  modes  (analog  and  digital)  and  the  manner 
in  which  the  information  was  presented  were  somewhat  arbitrarily  chosen. 
The  analog  and  digital  displays  used  in  this  study  were  not  themselves 
the  objects  of  study,  the  object  of  study  was  the  IOS  display  evaluation 
technique. 

The  experimental  variables  are  represented  in  the  accompanying  block 
diagram.  Figure  2. 


IV.  Experimental  Design 


The  design  of  the  present  study  differs  from  the  previous  one  primarily 
in  that  it  utilized  a  larger  number  of  subjects  (20  current  Air  Force 
pilots  as  opposed  to  four  non-military  pilots)  and  yielded  three  times 
as  much  data  per  subject.  The  design  permits  a  look  at  the  interactions 
among  the  several  variables.  Of  particular  interest  is  the  time  factor, 
that  is,  the  time  during  the  flight  segment  to  which  the  question  ap¬ 
plies  and  thus  the  length  of  time  during  which  the  information  must  be 
retained. 
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The  time  factor  would  be  expected  to  interact  with  display  format  and 
type  of  question.  Range-type  questions  might  prove  easier  to  answer. 

The  six  questions  were  generated  by  reference  to  strip  chart  recordings 
of  the  six  flight  parameters  displayed  for  each  flight  segment.  These 
questions  and  the  correct  answers  are  shown  in  Appendix  D.  Question  types 
were  counterbalanced  to  insure  their  equal  representation  across  maneu¬ 
ver  types  and  flight  parameters  for  each  of  the  two  displays.  Questions 
were  devised  on  the  basis  of  subjective  decisions  regarding  the  probable 
clarity  with  which  they  would  be  interpreted  by  the  observer  pilots. 

In  some  cases,  the  questions  referred  to  relatively  minor  variations  of 
flight  indication  because  of  the  path  flown  by  the  simulator  pilot.  For 
example,  if  the  maneuver  was  a  straight  climb,  successful  pilotage  would 
result  in  a  constant  heading,  though  the  design  of  the  study  would 
require  the  generation  of  a  question  regarding  change  of  heading. 

The  time  factor  was  also  taken  from  the  strip  chart  of  the  various 
flight  parameters.  The  elapsed  time  between  the  occurrence  of  a  reques¬ 
ted  indication  and  the  end  of  the  flight  was  noted.  Though  this  datum 
did  not  accurately  indicate  the  time  between  the  flight  indication  and 
the  question  pertaining  to  it  (because  of  sequencing  of  questions  in  the 
post-flight-segment  inquiry  period),  nevertheless  it  was  chosen  as  the 
most  reasonable  approximation,  given  the  alternative  of  a  cumbersome 
measurement  procedure. 

The  order  in  which  the  various  flight  parameter  questions  were  asked  was 
randomized  independently  for  every  flight  segment  and  for  each  ODserver 
pilot.  The  type  of  question  associated  with  a  given  maneuver  was  counter 
balanced  across  the  four  examples  of  that  maneuver  but  remained  the  same 
for  all  observer  pilots.  The  forty  flight  segments  were  randomized 
independently  for  each  observer  pilot.  Display  type  and  maneuver/ rep¬ 
lication  were  thus  randomly  variable  according  to  a  computer-generated 
random  order  (2  displays  by  5  maneuvers  by  4  question  types).  These  are 
contained  in  Appendix  E. 

The  primary  statistical  analysis  used  for  the  determination  of  the 
adequacy  of  the  105  display  evaluation  technique  for  discriminating 
between  display  types  was  the  analysis  uf  variance.  This  type  of  analy¬ 
sis  was  chosen  because  it  permitted  the  main  effects  and  the  interac¬ 
tions  among  them  to  be  seen.  Additional  analyses  included  correlations 
between  display  types  for  each  flight  parameter  and  item-test  correla¬ 
tions  of  the  mean  error  for  each  question  with  the  mean  of  the  total 
errors  fov*  each  flight  parameter.  Error  magnitude  correlation  with  time 
interval  was  also  calculated. 


V.  Procedure 


Those  who  served  as  observers  in  this  study  were  Military  Airlift  Com¬ 
mand  pilots  from  McChord  AFB  south  of  Seattle,  Washington.  Eighteen 
were  C-13Q  pilots  and  two  were  C- 141  pilots.  All  were  cooperative  and 
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seemed  interested  in  the  problem  of  IOS  displays,  with  the  reservation 
that  they  tended,  in  an  understandable  way,  to  react  to  the  task  within 
the  frame  of  reference  of  the  MAC  pilot  rather  than  as  an  instructor  at 
an  IOS  associated  with  a  single  seat,  high-performance  fighter  simu¬ 
lator.  Because  of  a  belief  that  the  nature  of  the  task  required  of  them 
would  be  performed  best  if  they  had  an  opportunity  to  get  away  from  it 
periodically,  two  pilots  served  al ternati vely  in  one-hour  sessions.  (K 
soon  became  evident  that  this  was  a  prudent  step  as  the  pilots  wearied 
at  the  task  after  about  an  hour).  Thus,  one  pilot  would  observe  the 
displays  and  answer  questions  while  the  other  could  view  nearby  simu¬ 
lation  facilities,  have  a  cup  of  coffee  in  the  cafeteria,  or  read  some 
material  of  general  interest  in  the  laboratory  area. 

The  40  flight  segments  comprising  the  complete  session  were  divided  into 
four  sub-sessions  of  10  each.  These  sub-sessions  were  a  little  less 
than  an  hour's  duration  and  two  subjects  could  be  run  in  a  single  day, 
each  serving  4  ho  rs  at  the  experimental  monitoring  task.  The  McChord 
AFB  pilots  were  assigned  to  the  1  day  temporary  duty  to  serve  in  the 
study  on  the  basis  of  availability.  The  average  age  of  the  pilots  was 
29.6  years  with  a  standard  deviation  (S.D.)  of  3.0  years.  Total  flight 
hours  averaged  2248  (S.D.  =  858).  Current  equipment  for  16  pilots  was 
the  C- 130  in  which  they  averaged  1128  hours  (S.D.  =  135).  All  had  flown 
the  T-37,  ranging  from  80  to  1700  hours  and  all  listed  time  for  the  T- 
38.  Ten  of  the  20  pilots  also  listed  civilian  light  aircraft  time. 

After  arriving  pilots  had  gone  through  the  required  check-in  procedures, 
the  experimenters  led  them  to  the  nearby  laboratory  facility  where  the 
display  equipment  for  the  test  was  located  (Visual  Flight  Simulation 
Laboratory).  Each  pilot  was  asked  to  fill  out  a  brief  form  (Appendix  F) 
for  information  about  his  age,  current  equipment,  and  flying  time  in  all 
types  of  aircraft.  The  observer  pilot  was  then  given  a  copy  of  instruc¬ 
tions  for  performing  the  task  (Appendix  A).  This  briefir.g  material 
included  a  general  explanation  of  the  goals  of  the  study  and  a  statement 
to  the  effect  that  the  pilots  were  not  being  evaluated  regarding  their 
personal  skills  but  that  the  display  evaluation  technique  itself  was  the 
subject  of  the  investigation. 

After  reading  the  instructions,  the  pilot  was  asked  whether  there  were 
any  questions  about  them.  The  next  part  of  the  task  familiarization 
included  showing  the  pilot  both  of  the  display  types:  i.e.,  analog 
instruments  and  digital  presentation  of  the  CRT.  The  pilot  was  then 
shown  how  to  cover  either  of  the  displays  for  the  viewing  of  its  alter¬ 
nate.  It  was  here  explained  that  the  display  mode  used  for  any  given 
flight  segment  was  determined  by  randomization.  This  was  also  true  for 
maneuver  type,  question  type,  and  flight  parameter.  The  presentation 
orders  for  each  pilot  are  shown  in  Appendix  E.  Flight  segment  numbers 
were  assigned  such  that  designators  1  through  20  referred  to  the  analog 
instrument  display  mode  and  designators  21  through  40  to  the  CRT  digital 
display  mode.  The  method  of  ordering  the  presentations  of  the  flight 
segments  is  called  random  without  replacement,  i.e.,  no  flight  segment 
(as  designated  above)  occurred  twice  for  a  given  observer  pilot  on  the 
same  display. 
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Prior  to  the  initiation  of  the  first  flight  segment,  the  experimenter 
pointed  out  the  flight  instruments  to  be  used  and  compared  them  with  the 
same  indications  as  shown  on  the  CRT  in  the  digital  display  mode. 

Figure  3  shows  both  display  modes.  Figures  4  and  5  show  each  display 
separately.  The  experimenter  pointed  out  the  locations  of  the  pitch  and 
bank  angle  indications  on  the  CRT  because  the  digital  attitude  display 
is  not  integrated  as  it  is  in  the  analog  instruments. 

The  CRT  was  positioned  above  the  instrument  panel  with  the  bottom  of  the 
scope  at  eye  level.  The  pilot's  eyes  were  located  about  53  cm  from  the 
screen  or  instruments.  Obviously,  there  were  variations  in  the  eye 
position  because  of  body  dimension  differences  among  pilots  or  different 
postures. 

The  tube  face  was  30  cm  wide  and  22.5  cm  high,  while  the  displayed 
information  was  20  cm  wide  and  7.5  cm  high.  Approximate  center-to- 
center  distances  between  adjacent  flight  indications  were  between  5  and 
6  centimeters.  Symbol  size  was  adequate  for  easy  reading. 

The  analog  instruments  extended  horizontally  38  cm,  vertically  22  cm. 

The  ADI  was  the  largest  instrument  at  10.7  cm  width,  while  the  heading 
indicator  just  below  it  was  second  largest  at  9.3  cm  width.  The  other 
three  instruments,  i.e.,  airspeed  indicator,  vertical  velocity  indica¬ 
tor,  and  altimeter,  were  all  7.3  cm  wide.  Center-to-center  distances 
from  the  ADI  to  the  other  instruments  were  15  cm  to  the  altimeter,  and 
13  cm  to  the  heading  indicator. 

A  mask  for  the  CRT  was  made  of  Fome-Cor  and  had  a  hinged  door  which 
could  swing  to  one  side  to  expose  the  face  of  the  CRT.  When  the  CRT  was 
being  used,  a  mask  was  set  in  place  to  occlude  the  analog  instruments. 
This  method  permitted  the  use  of  simpler  equipment  design  than  would 
have  been  necessary  if  one  mode  had  to  be  disabled  while  the  other  was 
being  used. 

Before  observing  the  final  10  flight  segments,  each  pilot  was  asked 
informally  to  comment  on  the  conditions  of  the  test.  Their  comments 
were  recorded  on  tape  (with  their  awareness)  for  later  study.  They  were 
asked  to  compare  the  two  display  modes  for  each  of  the  six  flight  para¬ 
meters  and  to  add  anything  they  might  have  to  say  about  the  quality  of 
the  questions  they  were  asked,  the  reasonableness  the  simulation,  the 
quality  of  the  test  environment,  or  the  conduct  of  the  test. 

Although  the  subjects  were  encouraged  by  the  experimenter  to  keep  trying 
if  they  expressed  doubts  about  their  performance,  they  were  told  nothing 
about  the  correctness  of  their  answers.  If  anyone  seemed  hesitant  about 
answering  a  question,  the  experimenter  asked  that  pilot  to  offer  a 


VI.  Results  and  Discussion 


The  independent  variable  of  greatest  interest  was  display  npde,  analog 
instruments  vs.  CRT  digital  format.  To  see  the  effect  of  this  variable 
on  the  monitoring  task,  a  separate  ANOVA  was  computed  for  each  of  the 
six  flight  parameters.  The  dependent  variable  in  each  analysis  was  the 
size  of  the  errors  in  the  responses  to  the  questions,  the  absolute  error 
magnitude.  Appendix  B  contains  the  raw  data,  that  is,  the  responses 
actually  given.  The  score  was  the  absolute  difference  between  the 
response  shown  in  Appendix  B  and  the  correct  response  for  that  question 
shown  in  Appendix  C. 

To  equate  the  four  question  types,  the  double-answer  questions  were 
treated  as  two  separate  questions  and  the  sum  of  the  errors  for  the  two 
were  averaged  to  yield  a  single  score  comparable  to  the  single  answer 
questions.  These  data  were  used,  along  with  the  errors  from  single¬ 
answer  questions,  in  the  ANOVA  for  the  six  parameters. 

The  ANOVA  and  means  of  pitch  angle  recall  errors  is  shown  in  Table  1. 
Pitch  angle  responses  were  given  with  smaller  error  when  the  observer 
had  been  viewing  the  flight  segment  on  the  analog  instruments  compared 
to  his  responses  after  a  digital  format  presentation  on  the  CRT  (p< 

.05).  While  the  difference  in  error  is  small,  3.04  degrees  for  analog 
and  3.64  degrees  for  digital,  the  size  of  the  error  difference  is  not  as 
important  as  the  demonstration  that  a  short-term  memory  task  like  this 
Ofic  Can  differentiate  between  display  types. 

The  type  of  maneuver  is  also  a  significant  main  effect  (p  <  .05).  This 
is  expected  because  of  the  correlation  between  maneuver  type  and  varia¬ 
tion  in  flight  parameter  values.  Question  type  was  also  significant  (p  < 
.05)  for  the  pitch  angle  ANOVA,  with  the  type  asking  for  the  extremes  of 
pitch  throughout  the  flight  segment  (Type  1)  yielding  smaller  error 
magnitudes  than  the  other  three  types.  The  reason  for  this  is  not 
clear,  especially  in  light  of  the  fact  that  the  third  type  of  question 
asking  for  just  one  extreme  (half  of  the  Type  1  question)  yielded  the 
largest  error  of  the  four. 

The  display  type  by  maneuver  interaction  is  significant  (p  <  .05;  for 
the  pitch  parameter  and  the  means  suggest  that  the  difference  in  favor 
of  the  analog  display  format  occurred  primarily  with  the  straight  climb 
and,  to  a  lesser  degree,  with  the  climbing  turn.  The  superiority  of  the 
analog  display  for  pitch  information  is  thus  not  uniformly  evident  for 
all  five  maneuvers,  not  appearing  in  the  cases  of  level  turn,  descent, 
and  descending  turn.  Maneuver  by  question  type  is  also  significant  (p  < 
.05).  For  example,  type  2  questions  yielded  the  worst  performance  of  all 
20  combinations  (four  question  types  x  five  maneuvers)  with  the  straight 
climb  maneuver  but  the  best  of  all  with  the  level  turn  maneuver. 

Finally,  the  significant  (p  <  .05)  display  by  maneuver  question  typo 
interaction  means  that  t he  maneuver  by  question  type  interact!'.  .a 
different  -for  the  two  displays,  being  more  marked  for  the  di  ital  tnan 
fur  the  analog  display. 


Table  1 


ANOVA  and  Means  of  Pitch  Angle  Recall  Errors  for  Display 
Type  (0),  Maneuver  Type  (M),  Question  Type  (Q),  and  Interactions 


Error 

Deg.  of 

Sum  of 

Mean 

i- 

Source 

Term. 

Freedom 

Squares 

Squares 

Ratio 

Suoiect 

19 

154.363 

8.124 

Display  Type  SO 

1 

73.811 

73.811 

10.449* 

Maneuver 

SM 

4 

962.919 

240.730 

37.478* 

Question  Type  SQ 

3 

235.264 

78.755 

10,757* 

SD 

19 

134.213 

7.064 

SM 

76 

488.164 

6.423 

DM 

SDM 

4 

217.494 

54.373 

11.541* 

SQ 

57 

417.303 

7.321 

Dq 

SDQ 

3 

23.594 

7.865 

1.246 

MQ 

SMQ 

12 

1811.072 

150.923 

19.404* 

SDM 

76 

358.069 

4.711 

i 

1 

SDQ 

57 

359.863 

6.313 

SMQ 

228 

1766.036 

7.746 

' 

DMQ 

SDMQ 

12 

135.224 

11.269 

2.237* 

SDMQ 

228 

1148.630 

5.038 

*p  <  .05 

Climbing 

Level 

Desi  ending 

Cl  imb 

Turn 

Turn 

Descent 

'1  rn 

Jil_ 

(2) 

(3) 

(4)... 

.  14)  . 

5.425 

3.188 

3.144 

2.712 

2.238 

DISPLAY  BY  MANEUVER 

Analog 

4-100 

2.933 

3.175 

2.700 

2.275 

Digital 

6.750 

3.438 

3.112 

2.725 

2.200 

QUESTION 

TYPE  BY  MANEUVER 

(1) 

4.825 

1.925 

1.950 

1.750 

1.700 

(2) 

7,825 

4.300 

1.400 

3.175 

1.550 

(3) 

6.725 

3.250 

1.775 

4.1/5 

3. 250 

(4) 

2.325 

3.275 

7.450 

1.750 

2.450 

DIS 

PLAY  BY  QUESTION  TYPE 

BY  MANEUVER 

Analog-1 

3.300 

1.800 

1.350 

1.750 

2.150 

2- 

5.200 

4.200 

1.750 

3.050 

1.250 

'  3 

5.900 

3 . 000 

2.000 

4.300 

3.300 

4_ 

2.000 

2.750 

7.600 

1.700 

2.400 

Digital-1 

OHO 

“2.050 

2.550 

1.750 

1.250 

2 

10.450 

4.400 

1.050 

3.300 

1.850 

3 

7 . 550 

3.500 

1.050 

4.050 

3.200 

4 

2.650 

3.800 

7.300 

1.800 

2.500 

DISPLAY 

Analog 

Dig-1'  tal 

3.038 

3.645 

QUESTION 

TYPE:  ( l)  2. 

430,  (2)  3 

650,  (3)  3 

.835,  (4)  3.450 

3  b 


Table  2  shows  the  ANOVA  and  means  of  roll  angle  recall  errcrs.  Roll 
angle  recall  performance  was  not  significantly  different  for  the  two 
displays.  Maneuver  types  showed  differences  since  those  involving  no 
tarns  varied  little  from  zero  roll.  Question  type  showed  significant 
differences  (p  <  .05),  wi  h  Type  1  (extremes  of  roll  during  the  flight 
segment)  associated  with  the  largest  error  and  Type  4  (single  indication 
at  a  specified  point  in  the  flight  segment)  the  smallest  error.  As  both 
maneuver  and  question  type  werQ  statistically  significant,  so  also  was 
the  interaction  between  these  two  factors  (p  <  .05);  the  pattern  of  this 
interaction  is  difficult  to  interpret,  however.  One  might  speculate 
that  in  piloting  an  aircraft  with  the  standard  artificial  horizon,  there 
is  little  concern  about  the  specific  number  of  degrees  of  roll,  and  that 
the  question  asking  for  this  number  would  tend  to  place  that  kind  of 
attitude  display  at  a  disadvantage.  Nevertheless,  there  was  no  signifi¬ 
cant  difference  in  favor  of  the  digital  format. 

Tabic  3  shows  the  ANOVA  and  means  of  heading  recall  errors.  Heading 
recall  was  not  significantly  different  for  the  two  display  formats. 

Type  of  maneuver  was  a  significant  factor  (p  <  .05)  with  the  level  turn 
resulting  in  far  larger  errors  than  was  the  case  with  other  maneuvers. 

It  should  be  pointed  out  that  there  was  greater  opportunity  for  error  in 
heading  recall  with  this  maneuver  because  the  heeding  change  was  about 
1.30  degrees,  as  opposed  to  the  climbing  and  descending  turns  which 
involved  heading  changes  of  90  degrees.  Question  type  significantly 
affected  heading  recall  performance  (p  <  .05),  with  Type  2  (change  in 
indication  during  some  limited  portion  of  the  flight  segment)  resulting 
in  che  largest  error.  Type  3  questions  yielded  errors  averaging  three- 
fourths  the  size  of  Type  2  errors,  but  the  remaining  two  question  types 
were  associated  with  errors  only  two-fifths  the  size  of  Type  2  errors. 
There  is  a  significant  interaction  (p  <  .05)  between  maneuver  type  and 
question  type  but  the  range  of  differences  in  the  20  combinations  of 
maneuver  and  question  type  suggests  the  possibility  of  a  serious  arti¬ 
fact.  The  largest  average  error  in  the  matrix  was  132.25  for  a  Type  3 
question  on  a  level  turn  while  the  same  type  of  question  about  a  stra¬ 
ight  descent  resulted  in  the  smallest  average  error  of  0.125.  The 
heading  recall  data  need  closer  scrutiny  before  they  can  be  interpreted 
unambiguously. 

Table  4  shows  the  ANOVA  and  means  of  airspeed  recall  errors.  Airspeed 
recall  performance  was  significantly  better  for  the  analog  display 
format  (p  <  .05).  Maneuver  type  was  again  a  significant  main  effect  (p< 
.05)  but  the  reasons  for  the  differences  observable  in  the  data  are  not 
immediately  clear.  The  average  airspeed  error  for  the  level  turn  is 
about  one-half  that  observed  for  three  of  the  other  four  maneuvers  and 
only  two  thirds  of  that  for  the  remaining  one.  Though  question  type  is 
not  significant  as  a  main  effect,  it  does  interact  significantly  with 
maneuver  type  (p  <  .05).  The  basis  for  this  interaction  is  not  appa¬ 
rent. 

Table  5  shows  the  ANOVA  and  means  of  altitude  recall  error.  Altitude 
recall  errors  were  not  significantly  different  for  the  two  display 
formats.  Maneuver  type  was  significant  (p  <  .05)  with  the  level  turn, 
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Table  Z. 


ANOVA  and  Means  of  Roll  Angle  Recall  Errors  for  Display 
Type  (D),  Maneuver  Type  (M),  Question  Type  (Q),  and  Interactions 


Error 

Deg.  of 

Sum  of 

Mean 

F 

Source 

Term. 

Freedom 

Square 

Squares 

Ratio 

Subject 

19 

1315.544 

69.239 

Display  Type  SD 

1 

7.220 

7.220 

0.094 

Maneuver 

SM 

4 

5294.918 

1323.729 

22.054* 

Question  Type  SQ 

3 

746.885 

248.962 

4.528* 

SD 

19 

1451.626 

76.401 

SM 

76 

4561.660 

60.022 

DM 

SDM 

4 

128.523 

32.131 

0.517 

SQ 

57 

3133.751 

54.978 

DQ 

SDQ 

3 

307.470 

102.490 

1.891 

MQ 

SMQ 

12 

2601.275 

216.773 

4.700* 

SDM 

76 

4725.688 

62.180 

SDQ 

57 

3088.623 

54.186 

SMQ 

228 

10516.60 

46.125 

DMQ 

SDMQ 

12 

607.268 

50.606 

1.103 

SDMQ 

228 

10463.18 

45.891 

*p  <  .05 

Climb 

Climbing 

Level 

Descending 

Turn 

Turn 

Descent 

Turn 

JIL 

(2) 

(3) 

(4) 

(5) 

1.688 

5.450 

5.700 

1.475 

8.200 

QUESTION  TYPE  BY 

MANEUVER 

(i) 

1.750 

8.725 

7.350 

4.900 

5.500 

(2) 

1.350 

5.225 

7.750 

0.0 

8.925 

(3) 

3.650 

3.200 

4.350 

0.150 

12.375 

(4) 

0.0 

4.650 

3.350 

0.850 

6.000 

QUESTION 

TYPE:  (1)  5. 

645,  (2)  4. 

650,  (3)  4. 

745,  (4)  2.970 
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Table  3: 


ANOVA  and  Means  of  Heading  Recall  Errors  for  Display 
Type  (D),  Maneuver  Type  (M),  Question  Type  (Q),  and  Interactions 


Error 

Deg.  of 

Sum  of 

Mean 

F 

Source 

Term. 

freedom 

Squares 

Squares 

Ratio 

Subject 

19 

94792.00 

4989.051 

Display  Type 

SD 

1 

8026.441 

8026.441 

3.612 

Maneuver 

SM 

4 

125262.5 

31315.63 

8.198* 

Question  Type 

SQ 

3 

84538.44 

28179.48 

5.066* 

SD 

19 

42227.18 

2222.483 

SM 

76 

290318.5 

3819.980 

DM 

SDM 

4 

7440.638 

1860.172 

0.541 

SQ 

57 

317027.3 

5561.879 

DQ 

SDQ 

3 

2140.688 

713.562 

0.190 

MQ 

SMQ 

12 

536719.8 

44726.65 

10.178* 

SDM 

76 

261191.4 

3436.729 

SDQ 

57 

214566.9 

3764.332 

SMQ 

228 

1001952. 

4394.523 

DMQ 

SDMQ 

12 

26969.56 

2247.463 

0.804 

5DMQ 

228 

637550.3 

2796.273 

*n  <  .05 

Cl  imb 
(1) 

Cl i mbi ng 
Turn 
(2) 

Level 

Turn 

(3) 

Descent 

(4) 

Descending 

Turn 

(5) 

23.631 

28.256 

50.875 

15.256 

19.069 

QUESTION  TYPE  BY  MANEUVER 

(1) 

0.300 

52  550 

7.675 

14.425 

14.050 

(2) 

69.875 

53.250 

44.275 

25.700 

19.400 

(3) 

1.800 

2.550 

132.250 

0.125 

19.825 

(4) 

22.550 

4.675 

19.300 

20.775 

23.000 

QUESTION  TYPE:  (1)  17.800,  (2)  42.500,  (3)  31.310,  (4)  18.060 
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Table  4: 


ANOVA  and  Means  of  Airspeed  Recall  Errors  for  Display 
Type  (D),  Maneuver  Type  (M),  Question  Type  (Q),  and  Interactions 


Erro*- 

Deg.  of 

Sum  of 

Mean 

F 

Source 

Term, 

Freedom 

Squares 

Squares 

Ratio 

Subject 

19 

7955.516 

418.711 

Display  Type 

SD 

1 

1180.980 

1180.980 

4.415* 

Maneuver 

SM 

4 

8909.305 

2227.326 

7.669* 

Question  Type 

sq 

3 

1410.525 

470.175 

2.232 

SD 

19 

5082.129 

267.480 

SM 

76 

22074.07 

290.448 

DM 

SDM 

4 

434.387 

108.597 

0.787 

SQ 

57 

12004.95 

210.613 

OQ 

SDQ 

3 

822.610 

274.203 

2.081 

MQ 

SMQ 

12 

7078.277 

589.856 

2.667* 

SDM 

76 

10489.30 

138.017 

SDQ 

57 

7511.195 

131.775 

SMQ 

228 

50426.39 

221.168 

DMQ 

SDMQ 

12 

1205.227 

100.436 

0.615 

SDMQ 

228 

37208.82 

163.197 

*p <  .05 

Cl imbing 

Level 

Descending 

Climb 

Turn 

Turn 

Descent 

Turn 

(2) 

(3) 

(4) 

(5).  _ 

14.625 

16.881 

7.169 

11.175 

13.962 

QUESTION  TYPE  BY 

MANEUVER 

(1) 

9.200 

16.600 

9.225 

9.600 

10.825 

(2) 

13.300 

14.425 

4.725 

15.150 

21.825 

(3) 

16.750 

19.750 

9.350 

12.925 

12.375 

(4) 

19.250 

15.750 

5.375 

7.025 

10.825 

DISPLAY 

Analoq 

Digital 

11.548 

13.978 

QUESTION  TYPE:  (1) 

11.090,  (2) 

13.885, 

(3)  14.230,  (4)  11.845 
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Table  5: 


ANOVA  and  Means  of  Altitude  Recall  Errors  for  Display 
Type  (D),  Maneuver  Type  (M),  Question  Type  (Q),  and  Interactions 


trror 

Deg.  of 

Source 

Term 

Freedom 

Subject 

19 

Display  Type 

SD 

1 

Maneuver 

SM 

4 

Question  Type 

SQ 

3 

SO 

19 

SM 

76 

DM 

SDM 

4 

SQ 

57 

DQ 

SDQ 

3 

MQ 

SMQ 

12 

SOM 

76 

SDQ 

57 

SMQ 

228 

DMQ 

SDMQ 

12 

SDMQ 

228 

"p<  .05 

Sum  of 

Mean 

F 

Squares 

Squares 

Ratio 

-45323E  08 

2385465 

. 34915  E  06 

349155 

0.100 

. 17753E  08 

4438392 

2.843* 

. 15627E  08 

5209320 

3.396* 

.66584E  08 

3504444 

. 11866E  09 

1561343 

.59676E  07 

1491920 

0.788 

.87436E  08 

1533975 

-16659E  07 

555303 

0.373 

.63764E  08 

5313693 

3.523* 

. 14380E  09 

1892141 

. 84865E  08 

1488863 

. 34393E  09 

1508472 

. 22421E  08 

1863460 

' 1.245 

.34215E  09 

1500682 

Climb 

ML. 

Climbing 

Turn 

- {jzl _ 

Level 

Turn 

m__ 

Descent 

(4) 

Descend! 

Turn 

(5) 

525.250 

597.475 

165.319 

416.962 

■  —  i  r  . 

358.525 

QUESTION  TYPE  BY 

MANEUVER 

U) 

(2) 

(3) 

(4) 

293.375 

557,625 

692.000 

558.000 

216.275 

1751.625 

129.375 

292.625 

202.625 

214.250 

100.900 

143.500 

211.575 

472.375 

430.400 

553.500 

369.500 

202.800 

477.550 

384.250 

QUESTION 

TYPE:  (1) 

258.670,  (2) 

639.735, 

(3)  366.045, 

(4)  386.375 
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as  expected,  associated  with  the  smallest  error.  Question  type  was  a 
significant  main  effect  (p  <  .05)  with  Type  2  questions  yielding  errors 
averaging  two-thirds  larger  than  the  next  poorest  question.  Type  4. 
Maneuver  interacts  significantly  with  question  type  (p  <  .05)  but  a  'ook 
at  the  matrix  suggests  cautious  interpretation.  On  several  occasions, 
the  pilot  not  accustomed  to  reading  a  three-needle  altimeter  made  errors 
as  large  as  10,000  feet. 

Table  6  shows  the  AN0VA  and  means  of  vertical  velocity  recall  errors. 
Vertical  velocity  indications  were  recalled  significantly  more  accura¬ 
tely  (p  <  .05)  with  the  analog  instrument  than  with  the  digital  presen¬ 
tation  on  the  CRT.  The  type  of  maneuver  was  again  significant  (p  <  .05) 
but  not  in  any  simple  way,  since  the  poorest  performance  occurred  with 
level  turns  while  the  best  occurred  with  straight  climbs.  Question  type 
is  a  significant  factor  with  this  flight  parameter,  with  the  Tycie  3 
question  (single  extreme  value  during  the  entire  flight  segment)  showing 
two  and  a  half  times  the  error  obtained  with  Type  2  (change  during  some 
limited  portion  of  the  flight  segment).  Display  format  interacts  signifi 
cantly  with  maneuver  (p<.05),  the  largest  difference  between  displays 
appearing  with  descending  turns  where  the  error  with  the  digital  mode 
was  twice  that  with  the  analog  instruments.  Question  type  also  inter¬ 
acts  significantly  with  maneuver  (p<.05)  but  not  in  any  clearly  systema¬ 
tic  way. 

The  ability  to  recall  information,  should  be  related  to  the  elapsed  time 
between  the  presentation  of  this  information  and  the  recall  attempt. 

Table  7  contains  the  correlation  coefficients  for  the  two  displays. 

In  one  analysis,  error  magnitude  is  compared  with  the  time  between  the 
occurrence  of  the  event  in  question  and  the  end  of  the  flight  segment, 
and  in  the  atner  analysis,  this  time  period  is  converted  to  a  percentage 
of  the  total  flight  segment.  The  coefficients  which  are  significantly 
different  from  zero  are  identified  by  asterisks  ( p  < . 05) . 

Although  36  of  the  120  correlations  in  the  table  as  a  whole  are  statis¬ 
tically  significant,  the  largest  is  r  =  .526  which  corresponds  to  an 
index  of  forecasting  efficiency  of  15%,  %  Efficiency  =  (1  -  1  -  r2)100. 

This  index  shows  the  percentage  reduction  in  errors  in  predicting,  perfor¬ 
mance  from  knowledge  of  the  time  interval  between  the  event  and  the  end 
of  the  flight  segment,  compared  to  predicting  the  mean  performance  for 
each  time  interval.  Those  correlations  around  r  =  .200  yield  an  index 
of  forecasting  efficiency  of  only  2%.  It  is  apparent  that  there  is  no 
strong  correlation  between  time  interval  and  error  magnitude. 

The  analog  display  mode  shows  significant  correlations  in  seven  cases 
when  time  interval  is  used  for  the  analysis  and  in  eight  cases  when  this 
time  interval  is  converted  to  percent  of  total  segment  time.  Not  unex¬ 
pectedly  most  of  these  cases  (six  out  of  eight)  overlap  in  the  two 
methods  of  analysis. 

The  digital  display  mode  shows  significant  correlations  in  11  cases  when 
the  analysis  is  of  time  interval  and  performance  and  in  10  cases  when, 
percent  segment  time  is  used,  all  10  overlapping  with  those  showing 
significance  in  the  time  interval  analysis. 
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Table  6: 


ANOVA  and  Means  of  Vertical  Velocity  Recall  Errors  for  Display 
Type  (D),  Maneuver  Type  (M),  Question  Type  (Q)  and  Interactions 


Error 

Deg.  of 

Sum  of 

Mean 

F 

Source 

Term. 

Freedom 

Square 

Squares 

Ratio 

Subject 

19 

.4417906E 

08 

2325213 

Display  Type 

SD 

1 

.  1709749E 

08 

17097490 

13.066* 

Maneuver 

SM 

4 

.2613584E 

08 

6533960 

2.797* 

Question  Type 

SQ 

3 

.  1199948E 

09 

39998260 

19.147* 

SD 

19 

.2486242E 

08 

1308548 

SM 

76 

.  1775190E 

09 

2335776 

DM 

SDM 

4 

.  1532442E 

08 

3831104 

2.753* 

SQ 

57 

. 1190743E 

09 

2089022 

DQ 

SDQ 

3 

. 1354378E  08 

4514592 

2.415 

MQ 

SMQ 

12 

. 2548061 E 

09 

21233840 

12.287* 

SDM 

76 

.'057711E 

09 

1391724 

SDQ 

57 

.  If 55726E 

09 

1869694 

SMQ 

228 

.3940280E 

09 

1728193 

DMQ 

SDMQ 

12 

.3133226E 

08 

2611021 

1.730 

SDMQ 

228 

.  3441272E 

09 

1509329 

*n  qg 

f#  V.  • 

Climb 

(1) 

Climbing 

Turn 

(2) 

Level 

Turn 

(3) 

Descent 

(4) 

Descending 

Turn 

(5) 

725.844 

1119.531 

1274.081 

1104.806 

1077.519 

DISPLAY  BY 

MANEUVER 

Analog 

Digital 

767.375 

684.312 

1004.375 

1234.688 

1108.712 

1439.450 

998.987 

1210.625 

691.375 

1463.662 

QUESTION  TYPE  BY  MANEUVER 

(1) 

(2) 

(3) 

(4) 

446.375 

387.500 
1757.000 

312.500 

1165.625 

1307.500 

516.250 

1488.750 

648.875 

401.200 

3350.000 

696.250 

616.875 

482.850 

1658.375 

1661.125 

963.875 

768.700 

996.250 

1581.250 

DISPLAY 

Analoq 

Digital 

1206.547 

QUESTION  TYPE:  (1) 

768.325,  (2) 

669.550,  (3) 

1655.575,  (4) 

1147.975 
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Table  7: 


DISPLAY  1  -  (Analog) 


Correlations  of  Error  With  Segment  Time  Remaining 


Maneuver/ 

Pitch 

Roll 

Heading 

Airspeed 

Altitude 

VVI 

Climb 

.306* 

-.526* 

-.041 

.035 

.106 

.163 

Climbing  Turn 

.138 

-.223* 

-.373* 

.066 

-.032 

.131 

Level  Turn 

-.249* 

-.082 

-.071 

-.032 

-.118 

.153 

Descent 

-.367* 

.176 

.114 

-.133 

-.081 

.139 

Descending  Turn 

-.221* 

.002 

.072 

-.365 

-.117 

-.130 

Correlations 

of  Error  With  Percent  Segment  Time  Remaining 

Cl  imb 

.278* 

-.475* 

.073 

.027 

.090 

.122 

Climbing  Turn 

.117 

-.201* 

-.358* 

.061 

-.043 

.133 

Level  Turn 

-.390* 

-.010 

-.009 

-.009 

-.126 

.212* 

Descent 

-.252* 

.227* 

.112 

-.129 

-.080 

.132 

Descending  Turn 

-.104 

.017 

.061 

-.336 

-.104 

-.088 

DISPLAY  2  -  (Digital) 


Correlations  of  Error  With  Segment  Tine  Remaining 


Cl  imb 

.485* 

-.238* 

-.043 

.083 

-.066 

.006 

Climbing  Turn 

.003 

- . 188* 

-.392* 

.234* 

.019 

-.200* 

Level  Turn 

-.287* 

-.172 

-.105 

.003 

-.081 

.198* 

Descent 

-.107 

.226* 

-.048 

-.193* 

.006 

.169 

Descending  Turn 

-.179 

-.155 

-.088 

-.237* 

-.025 

.018 

Correlations 

of  Error  With  Percent  Segment  Time  1 

Remaining 

Climb 

.517* 

-.174 

.044 

.081 

-.063 

.070 

Climbing  Turn 

-.023 

-.199* 

-.381* 

.240* 

.002 

-.199* 

Level  Turn 

-.268* 

-.125 

-.040 

.027 

-.039 

.287* 

Descent 

.174 

.284* 

-.046 

-.186* 

.022 

.158 

Descending  Turn 

-.168 

-.140 

-.121 

-.240* 

-.054 

.005 

p  <  .05 
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For  the  analog  display,  correlations  of  error  witn  intervening  time  were 
significant  in  seven  instances,  only  one  of  which  is  positive  in  sign. 
This  instance  occurred  for  the  flight  parameter  of  pitch  in  the  climb 
maneuver.  However,  each  correlation  is  based  on  six  responses  to  four 
questions  (see  discussion  of  question  types,  section  )  by  20  pilots. 
While  the  magnitude  of  error  in  a  response  can  vary  widely  among  the  20 
pilots,  the  corresponding  time  interval  is  fixed  at  a  single  value. 

The  content  of  a  question  was  dictated  mostly  by  the  availability  of  an 
event  involving  the  given  flight  parameter,  that  is,  an  event  about 
which  a  question  could  be  formed.  The  starting  point  for  the  generation 
of  questions  (Appendix  C)  was  the  detailed  inspection  of  the  strip  chart 
records  (Appendix  D).  The  choice  of  question  was  further  restricted  by 
the  question  type  it  had  to  represent.  The  point  in  the  time  segment 
where  occurred  the  event  corresponding  to  the  desired  question  left 
little  or  no  choice  for  a  balanced  selection  of  time  intervals. 

The  digital  display  yields  results  similar  to  the  analog  display  in  that 
the  most  significant  correlations  of  error  performance  with  time  inter¬ 
val  are  negative  (seven  out  of  11).  Since  the-  test  is  the  same  as  that 
used  with  the  analog  display,  the  discussion  of  the  results  for  the 
analog  mode  applies  here  as  well. 

If  the  results  of  the  correlational  analysis  are  accepted  as  meaningful 
on  the  basis  of  statistical  probability  even  though  the  coefficients  are 
not  high,  then  it  is  assumed  that  there  is  a  tendency  for  the  subjects 
to  remember  earlier  flight  indications  better  than  later  ones.  However 
the  possibility  that  these  results  are  due  to  artifacts  in  the  flight 
segments  as  flown  or  in  the  test  questions  cannot  be  excluded. 

The  study  was  not  designed  to  treat  the  elapsed  time  question  in  a 
systematic  way.  The  lack  of  a  strong  correlation  between  error  magnitude 
and  elapsed  time  is  therefore  not  a  conclusive  finding. 

Item-Test  Correlations 


The  item-test  correlations  are  shown  in  Table  8.  The  error  scores  for 
question  types  1  and  2  were  the  average  of  the  errors  in  the  two  answers 
given.  These  were  added  to  the  error  scores  from  question  types  3  and  4 
and  total  errors  were  summed  across  the  20  questions  (five  maneuvers  x 
four  question  types)  for  the  subject  to  obtain  a  single  score  on 
that  flight  parameter.  The  correlation  coefficients  range  from  .810  to 
.015  in  magnitude,  and  20  coefficients  are  negative.  The  lower  the 
correlation,  the  less  the  question  contributes  to  the  total  score  and  if 
the  sign  is  negative,  larger  errors  in  responses  to  that  question  are 
associated  with  smaller  total  error  scores.  Such  an  item  lacks  homogeneity 
with  the  other  questions  about  that  flight  parameter,  and  its  inclusion 
in  the  test  tends  to  weaken  or,  if  negatively  correlated  with  the  total, 
run  counter  to  measurement  goals.  Therefore  removing  or  improving  low 
and/or  negatively  correlated  items  should  improve  the  test. 
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Table  8: 


Item-Test  Correlations  (Analog  Display) 


Maneuver 
Cl  imb 


Climbing  Turn 


Level  Turn 


Descent 


Run 

Pitch 

Roll 

1 

.291 

.309 

2 

.432 

.041 

3 

-.102 

.207 

4 

.194 

- 

1 

.356 

.025 

2 

.418 

.602 

3 

-.052 

.592 

4 

.365 

.550 

1 

.183 

.035 

2 

.528 

.201 

3 

.355 

.516 

4 

-.176 

.215 

1 

.128 

.097 

2 

.090 

- 

3 

.346 

.020 

4 

.256 

.448 

1 

.060 

.153 

2 

.049 

.547 

3 

.349 

.382 

4 

-.109 

.166 

Heading  Airspeed 


- .  343 

.579 

.544 

.017 

.486 

.155 

.113 

.437 

.200 

.439 

.384 

.403 

- 

.244 

.056 

-.070 

o  /->  /• 

nr  c 

.  UUJ 

.405 

.196 

.316 

-.131 

.035 

.581 

.427 

.243 

.359 

..344 

.122 

.  046 

.241 

-.066 

-.352 

.187 

-.031 

.509 

.345 

.066 

.040 

.127 

Vertical 
Altitude  Velocity 


-.026 

.394 

.600 

-.133 

.261 

.174 

.787 

.759 

-.020 

.223 

.760 

.419 

-.100 

.552 

.269 

.277 

.  180 

.  229 

.086 

.492 

-.122 

.387 

-.061 

.810 

.020 

.406 

-.032 

.018 

-.161 

.180 

-.093 

-.015 

.848 

.144 

.025 

-.138 

.027 

.046 

.851 

.361 

Descending  Turn 


VII.  Conclusions  and  Recommendations 


The  objective  of  this  study  was  to  test  an  STE  display  evaluation  tech¬ 
nique,  that  is?-  to  demonstrate  its  validity  by  applying  it  to  two  osten¬ 
sibly  different  display  types  and  measuring  the  ability  of  IP's  to 
recall  specific  flight  indications  shown  during  short  flight  segments  of 
five  different  maneuvers,  viz.,  climb,  climbing  turn,  level  turn,  de¬ 
scent,  and  descending  turn.  The  flight  parameters  representing  the  flight, 
segment  included  airspeed,  pitch  angle,  roll  angle,  altitude,  vertical 
velocity, and  heading.  These  six  flight  parameters  were  analyzed  sepa¬ 
rately  to  determine  the  sensitivity  of  the  evaluation  measure  to  display 
differences.  The  goal  was  to  validate  the  IOS  display  evaluation  tech¬ 
nique  to  determine  whether  it  would  be  worthwhile  for  the  Air  Force  to 
pursue.  In  light  of  these  results,  the  IOS  display  evaluation  technique 
described  in  this  report  deserves  further  attention,  given  that  the 
goals  of  the  technique  in  this  period  of  its  development  appear  to  have 
been  realized.  The  deficiencies  which  are  evident  are  apparently  not 
insuperable,  although  attention  is  needed  in  several  aspects  of  the 
test. 


The  most  logical  approach  to  the  selection  of  questions  for  the  bench¬ 
mark  task  would  be  to  choose  flight  segments  from  a  larger  group  of  such 
segments  to  obtain  a  greater  variety  of  reportable  events  and  time 
intervals.  Though  logical,  it  may  be  uneconomical  because  of  the  large 
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of  those  ultimately  sought  but  make  the  effort  a  worthy  one  within  a 
realistic  framework. 


One  consideration  pertinent  to  the  understanding  of  the  present  data 
relates  to  the  airplane  being  simulated  by  fhe  computer  program  or  data 
base.  This  simulated  airplane  is  an  "educated  guess"  about  the  flight 
characteristics  of  some  future  extension  of  the  A-7,  referred  to  infor¬ 
mally  as  the  "Super  A-7."  C-130  or  C-141  pilots  would  be  expected  to 

perform  much  better  on  a  task  based  on  an  airplane  with  more  familiar 
flight  characteristics.  It  may  well  be  necessary  to  have  sets  of  ques¬ 
tions  relating  to  various  general  aircraft  types  so  that  the  observers 
evaluating  a  display  can  be  matched,  in  terms  of  current  experience,  to 
the  display's  intended  application.  Certainly,  the  "super  performance" 
of  the  simulated  airplane  in  this  study  was  confusing  to  the  MAC  pilots 
who  served  in  the  present  study. 

Another  aspect  of  the  flight  characteristics  of  the  simulated  airplane  was 
the  interaction  of  these  flight  characteristics  with  the  instruments 
used  in  the  analog  display.  For  example,  the  strip  chart  recording  of 
one  flight  (Climb,  Run  2)  shows  an  airspeed  of  700  knots  though  the 
maximum  limit  for  the  airspeed  indicator  is  500.  Another  example  is  the 
vertical  velocity  indicator  which  reads  a  maximum  of  5800  ft/min  while 
vertical  speeds  frequently  exceed  this  value.  (Maximum  values  for 
analog  instruments  were  used  to  set  maximum  values  for  the  CRT  digital 
display.)  These  display  limitations  (or  airplane  excessive  performance) 
cause  the  evaluative  power  of  the  test  to  be  weakened. 
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Another  weakness  in  the  present  study  had  to  do  with  the  current  experi¬ 
ence  of  the  pilots  serving  as  observers  in  the  study.  In  several  instan¬ 
ces  an  altitude  question  received  a  response  from  a  C-141  pilot  which 
was  10,000  ft.  in  error  because  he  was  accustomed  to  a  tape  readout 
rather  than  dial-and-needle  indications. 

For  some  pilots  who  are  accustomed  to  reading  roll  angle  (bank)  indica¬ 
tions  at  the  bottom  of  their  ADI,  there  was  a  tendency  to  read  right  for 
left  and  vice. versa  on  the  one  used  in  this  study  which  had  roll  indica¬ 
tion  at  the  top.  This  may  account  in  part  for  the  lack  of  significant 
difference  between  the  means  for  analog  vs.  digital  in  the  ANOVA ,  since 
in  the  digital  mode  the  left-right  designation  is  alphabetic  rather  than 
being  a  tilt  with  respect  to  the  artificial  norizon.  Roll  angle  inter¬ 
acts  with  the  type  of  maneuver  in  some  fairly  obvious  ways;  in  an  attemp¬ 
ted  straight  climb  or  descent  the  roll  angle  will  remain  close  to  zero 
and  the  size  of  the  average  error  for  these  maneuvers  will  be  correspon¬ 
dingly  small . 

Heading  recall  errors  were  difficult  to  score  because  the  magnitude  of 
the  error  was  not  as  simply  defined  as  with  altitude.  For  example, 
should  an  observer  report  the  heading  to  be  010  degrees  (as  presented  on 
the  analog  instrument)  when  it  was  in  fact  020  degrees,  the  error  is 
easily  scored  as  10.  Likewise,  a  report  of  170  degrees  instead  of  the 
correct  heading  of  190  degrees  is  scored  as  an  error  of  20.  However,  if 
the  error  is  a  difference  between  a  heading  greater  than  270  and  les* 
than  090  the  magnitude  of  the  error  is  numerically  larger  than  one  of 
the  same  angular  difference  between  a  heading  greater  than  090  and  less 
than  270.  A  solution  might  be  to  measure  the  error  as  angular  differ¬ 
ence,  but  this  approach  would  make  no  sense  applied  to  the  digital 
display.  Since  the  comparison  of  the  two  display  types  requires  compara¬ 
ble  measures,  it  appeared  more  justifiable  to  score  responses  in  terms 
of  numerical  difference  than  to  treat  the  digital  display  responses  as 
though  it  presented  heading  information  in  a  way  comparable  to  the 
analog  instrument,  i.e.,  the  round  dial  and  pointer. 

The  vertical  velocity,  as  displayed  on  the  round  dial  (analog)  instru¬ 
ment  is  another  potential  source  of  unwanted  variation  in  the  data.  If, 
in  a  given  flight  segment,  the  maximum  upward  velocity  was  5000  (+5000) 
feet  per  minute  and  the  maximum  downward  velocity  was  4900  (-4900)  feet 
per  minute,  a  report  regarding  maximum  vertical  velocity  of  -<900  would 
be  scored  as  an  error  of  9900  feet  per  minute.  As  a  deviation  from  zero 
feet  per  minute  of  vertical  velocity  the  error  is  only  ICO  although  the 
algebraic  difference  is  9900.  Of  course,  the  same  kind  of  error  may 
occur  with  the  digital  display  if  the  observer  recalls  a  value  with  a 
negative  sign  when  it  was  positive  or  vice  versa.  If  a  value  recalled 
is  the  largest  negative  value  while  the  largest  value  is  actually  posi¬ 
tive,  scoring  can  be  based  either  on  the  basis  of  the  difference  between 
the  absolute  values  or  on  the  angular  difference  between  reported  and 
correct  values  (algebraic  difference),  depending  on  the  conceptual 
framework  used.  The  choice  made  for  this  study  was  to  take  the  alge¬ 
braic  difference  for  questions  about  maximum  vertical  speed  without  the 
direction  (up  or  down)  being  specified  in  the  question. 
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Further  improvement  in  the  technique  for  evaluating  IDS  displays  should 
start  with  selecting  or  generating  flight  segment  tapes  which  have  the 
range  arid  variety  of  characteristics  from  which  to  select  items  corres¬ 
ponding  to  the  question  categories.  The  events  to  which  the  questions 
refer  should  be  easily  distinguishable  from  other  activity  in  the  flight 
segment.  In  the  present  study  some  events  used  for  trie  questions  were 
not  as  distinctly  separated  from  other  activity  as  may  be  desired. 

A  longer  time  should  be  devoted  to  making  sure  that  each  observer  can 
read  the  instruments  correctly  and  understand  the  kinds  of  questions  to 
be  asked.  A  response  system  should  be  developed  to  permit  observers  to 
perform  the  task  without  requiring  the  presence  of  someone  to  record 
data. 

The  need  for  quanti tative,  objective  measures  of  quality  for  intelligent 
procurement  of  advanced  displays  has  received  frequent  mention,  but  not 
much  has  been  done  to  remedy  the  problems  associated  with  the  more  usual 
haphazard,  subjective  selection  methods.  The  reason  for  this  state  of 
affairs  is  probably  due  to  the  magnitude  of  the  effort  needed  to  produce 
an  objective  evaluation  technique. 

The  concept  of  the  benchmark  task  applied  to  this  problem  is  demon¬ 
strably  worthwhile.  Though  it  may  require  a  number  cf  iterations  before 
it  is  developed  to  a  satisfactory  level,  this  evaluation  technique  is  a 
way  out  of  the  problems  of  older  methods.  The  program  should  receive 
the  continuity  of  attention  required  to  maintain  the  momentum  necessary 
to  bring  it  to  success. 


38 


iJitJLAL'ijKftPHY 

Donaldson,  T.S.  Suuiective  scaling  of  stuoent.  pert onnance.  Kane-  P-4:»o, 
March  197i. 

tngel,  3,0.  Am  approach  to  standardizing  human  performance  assessment. 
(AQ-717  258).  George  »,'asningt^n  university,  Human  Resources  Kesearcn 
Organization,  uctooer  1770. 

^Evaluation  of  instruction.  Chief  of  Naval  t.uucation  ano  Training, 
CNTZCHTRA  Instruction  1540. 1 ',  J^zA  as  of  January  l7?5. 

**Faconti,  V. ,  Mortimer,  C.P.  L. ,  &  Cimpson,  u.w.  Automateo  instruction 
ang  performa'i?  monitoring  in  fi.iqnt  simulator  training. 

AFHR_- IK-67  -2V.  AU-704  J.2U.  wrignt-Patterscn  A  Fa,  Uh:  Training 

Research  Division,  Air  force  Human  Resources  Laooratory,  feuruary 
1970. 

Facooti,  V. ,  &  Epps,  R.  Advanceu  simulation  in  ungergraouate  Pilot 
Training;  Auto  instructional  system.  AKHRl-TK-7^-J9v.j.V) . 
A2-Aul7-lfa5.  wrignt-Patterson  Afb,  UH:  Auvanceo  bystems  Division, 

Air  force  Human  Resources  Laooratory,  uctooer  1775. 

*Finley,  D.L.,  Rouins,  J.t. ,  &  Ryan,  T.g,  Training  effectiveness 

evaluation  of  naval  training  gevices.  (Au-vua  UJ4l.  uunKer-Raino 
Corporation,  WestlaK.e  village  Electronic  —  tt.c, ,  uecemoer  l77z. 
*fogel,  L.J.,  et.  al.  Investigation  of  principles  of  control/uisplay  for 
RPVs.  (AU-7&7  4l4 ) .  uecision  Science,  inc.,  feuruary  1775. 

*fromer,  R.,  Horowitz,  M.rt.  flignt  information  uispla/  for  instructional 
consoles.  Teen.  Report  2U-uS,  Septemoer  l7xu 


*GophfT,  D.,  et.  al.  Tne  measurement  of  operator  capacity  uy  manipulation 
of  Qual-tasK  oemanus.  lAu-AOUo  >3z).  Illinois  university  bavoy 
Aviation  Kesearcn  Laooratory. 

Hunter,  C.C.  New  dimensions  to  instruction.  uSAF  instructors  journal, 
197U,  au)-ll-15 

Enhancement  of  human  effectiveness  in  system  design.  tAu-AuU4  14s1). 
Training  June  1974.  Illinois  university  Savoy  Aviation  Kesearcn 


Laooratory. 

The  impact  of  full  mission  simulation  of  tne  TAG  comoat  crew  training 
system.  (AQ-B0Q4  4i>7L).  Air  War  College,  Maxwell  AFd,  AlaDama, 

April  197b. 

**KanaricK,  A.F.,  ^t.  al.  Effects  of  value  on  tne  monitoring  of  multi- 
cnannel  displays.  Human  Factors,  190*,  Vol.  11. 

*Man  -  Tne  focus  of  trig  training  system.  (Au-7oti  7bo).  Proceedings  of  tne 
Naval  —  Etc.,  Naval  Training  Equipment  Center,  urianjo,  fluriua, 

,  Ncvernoer  1973. 

McGratn,  J.,  &  Harris,  0.  (Eos.)  Auaptive  training  aviation  researcn 


Inst,  of  Aviation,  university  of  Illinois,  August  1*71. 


Miller,  G.G.  Some  considerations  in  tne  design  ana  utilization  of 


simulators  for  tecnnical  training.  Ai-HRL-TR-74-e»:>,  Aj-Auul-tou. 


Lowry  AFD,  CO:  Tecnnical  Training  Division,  Air  rorce  Human 


Resources  Laooratory,  August  1974. 

Miller,  R.L.  Techniques  for  tne  initial  evaluation  of  flight  simulator 
effect.  (, AD-A036  460).  wrignt-Patterson  AFb,  uh;  Air  force 
Institute  of  Technology,  Decemoer  1*76. 


40 


*Pearlstein,  R.B.,  Schumacner,  S.P.,  Rif Kin,  K.t.  information  uispla 
guide.  Valencia,  PA:  Applied  Sciences  Association,  inc.,  1*74. 

Preliminary  qound  instructor's  pilot  manual.  Naval  Air  Systems  Command, 
Displays  ana  Deoriefing  Suosystem  (.DoS).  Air  Coinoat  Maneuvering 
Range,  (Second  Edition,  Johns  HopKins  University,  Silver  Springs, 
1975). 

**Priee,  h.E.  Human  engineering  recommendations  for  tne  instructor 

pilot's  station  of  the  ASJ-1  weapon  system  trainer.  <,Au-o7a-371  anu 
37U).  Report  PRA-56-I3,  Septemoer  1*56. 

★Prophet,  W.W.,  Caro,  P.W.,  Hall,  t.R.  Some  current  issues  in  tne  uesign 
of  flight  training  devices.  (AD-743  z7U).  Alexandria,  V A:  Human 
Resources  Research  Organization,  1971. 

Rose,  H.C.  A  plan  for  training  evaluation.  Training  anu  Development 
Journal,  1*68. 

*Ryan,  l.E. ,  Puig,  J.A.,  &  Micheli,  G.S.  An  evaluation  of  tne  training 
effectiveness  of  device  2F*0.  \,AD-73U  24b).  naval  Training 

Equipment  Center,  Orlando,  Floriua,  August  l*7z. 

Shipley,  B.D.  Measurement  of  flight  performance  in  a  flight  simulator. 
AD-A004  486.  Report  l\lo.  TK-4063U,  Arizona  State  University, 

Education  Department. 

Snipley,  b.d.  An  automated  measurement  tecnnique  for  evaluating 

pilot  skill.  (AD-AU33  92U).  Arizona  State  university,  Tempe  college 
of  Education,  Feuruary  1*76. 

Smooe,  A.F.  Human  factors  inputs  to  tne  training  device  uesign 
process.  NAVTRAUtVCEN  6*-C-U2yd-l.  nTEC,  1*71. 


41 


**Smodp,  A.f.  Recent  developments  in  instructor  station  uesiyn/utilUation 
for  fliynt  simulators.  human  factors,  1974,  Vel.  lo. 

*Srnode,  A.f.,  Lam,  K.t).  teas.  )  Proceedings  of  tne  Conference  on  Military 
instructor  Training  in  Transition.  TAtu  Report  wo.  cs,  way 

Stanley,  m.u.  A  Metnou  for  ueveloping  a  criterion  for  uomoat  Pertormance. 
(AD-766  679).  Monterey,  CA:  waval  Postyrauuate  Scnoul,  June  1 976. 

*Swain,  A.U.  Guide  for  tne  oesign  anu  evdludtion  of  tne  instructor 'a 

station  in  training  equipment.  rtAuc-Td-p^ooe,  Ag-72  lux  jecemuer 
1964. 

Synthetic  trainer  instructor's  goiue.  Port  nuoxe r ,  Au;  u.S.  Army  Aviation 
Scnool,  Povemoer  !9o9. 

Thoinas,  R.,  &  Klin*3,  j.M.  Pilot  performance  do  d  function  of  tnree  types 
Of  altitude  displays.  tAj-766  729).  ASU,  bPAf ri ,  Auyust  l*/c. 

**Tyler,  D.M.,  et.  al.  Monitoring  performance  dcrods  sense  mooes  -  ah 
individual  difference  approacn.  numan  factors,  lv/c,  vol.  14. 

**Valveroe,  H.H.  A  review  of  fliynt  simulator  transfer  of  traininy 
studies.  Human  factors,  1976,  _l_6to). 

*rtneaton,  G.R. ,  Miraoella,  A.,  a  farina,  A.j.  Trainee  anu  instructor  tas* 
qualification;  development  of  quantitative  inulces  ^no  u  predictive 
iiiHtriodoloq/ .  Darin,  Dunlap  a  Association,  inc . ,  January  19/1. 

Weyer,  U.C.,  &  fuller,  J.H.  Ueveiopment  of  a  s/llauus  anu 

Student/instructor  guio*3  for  use  with  a  full  mission  simulator. 
AFHKL-TH-76-9U,  AU--AU6 /  62l.  williams  Afo,  Ac:  flying  Training 
division,  Air  force  Human  resources  uauuratory,  uecemoer  la/o. 

Young,  f.c.  Concept  formulation  report,  s/ntnetic  training  system. 

I 

(Au-b76  6U d).  falls  uiui'cn,  v A;  Me) par,  j.nc.,  April  Isuo. 


42 


Zipoy,  O.H.,  et.  al.  Integrated  information  presentation  anj  control 


system  stuay.  AFFOL-Ttt- 70-79,  Vol.  i  tnrougn  IV,  July  1*70  to 


January  1973, 


A3 


APPENDIX  A:  INSTRUCTIONS  TO  SUBJECTS 


You  have  been  asked  Co  take  part  in  a  research  project  aic^d  at  develop¬ 
ment  of  evaluation  techniques  for  flight  simulator  instructor /operator 
displays.  It  is  to  be  noted  that  the  displays  which  you  will  be  viewing 
are  not  under  evaluation  nor  do  they  represent  the  state  of  the  art  in 
display  technology.  These  displays  are  merely  vehicles  for  testing  the 
evaluation  method  under  consideration. 

A  series  of  short  flight  segments  were  flown  in  a  flight  simulator  and 
recorded.  These  recorded  data  will  be  played  back  to  you  on  two  dif¬ 
ferent  displays  -  analog  flight  instruments  and  digital  CRT.  After 
viewing  each  flight  segment  you  will  be  asked  to  respond  to  a  set  of 
questions  concerning  the  displayed  data.  Basically,  we  are  trying  to 
determine  if  this  method  can  be  used  to  ascertain  the  relative  efficacy 
of  alternative  displays  for  providing  different  types  of  information  to 
the  instructor  located  at  a  remote  station.  Keep  in  mind  it  is  this 
method  for  determining  the  power  of  the  display,  to  provide  certain 
types  of  information  under  certain  conditions,  which  is  under  evaluation 
and  not  your  individual  powers  of  observation.  It  is,  in  fact,  hoped 
that  observers  are  more  alike  than  different  in  their  powers  of  observa¬ 
tion  and  that  individual  differences  will  prove  to  be  insignificant. 

The  questions  will  be  of  four  types  categorized  on  the  basis  of  the  kind 
of  memory  task  implied.  For  example,  the  question  may  relate  to  the 
extreme  values  of  a  given  flight  parameter  the  answer  to  which  requires 
retention  of  display  contents  over  the  entire  flight  segment.  Such  a 


question  may  be  worded  in  the  following  way:  "What  were  the  extremes  of 
airspeed  during  the  flight  segment?"  The  question  concerns  a  range  of 
values  over  an  extended  period  of  time. 

A  second  type  of  question  deals  also  with  a  range  of  values  but  refers 
to  a  particular  point  in  the  maneuver,  e.g.,  "What  was  the  change  in 
airspeed  in  the  transition  to  level  off:"  The  answer  requires  the 
naming  of  two  values,  one  displayed  just  before  transition  to  level-off 
was  started,  another  after  it  was  completed. 

The  third  and  fourth  types  of  question  ask  for  single  specific  values 
rather  than  ranges.  Like  the  first  type,  the  third  kind  of  question 
applies  to  the  entire  flight  segjnent,  e.g.,  "What  was  the  highest  airspeet 
during  the  flight  segment?"  (This  particular  question  is  implied  in 
the  first  question  about  extremes  of  airspeed.) 

The  fourth  type  of  question  is  like  the  Qecond  type  in  that  it  asks  for 
display  content  at  some  particular  point  in  the  flight  segment  and  like 
the  third  type  in  that  a  single  specific  value  is  requested. 

The  average  duration  of  the  flight  segments  is  a  little  less  than  2-1/2 
minutes.  They  will  represent  five  basic  flight  maneuvers:  straight 
climb,  climbing  turn,  level  turn,  straight  descent,  and  descending  turn. 

The  flight  indications  displayed  will  most  probably  not  be  representative 
of  aircraft  with  which  you  are  familiar  since  the  computer  program  was 
designed  to  simulate  a  developmental  high  performance  aircraft. 

You  will  be  asked  questions  after  each  flight  segment  on  each  of  six  fligh 
parameters:  pitch,  roll,  heading,  vertical  velocity,  altitude,  and  bearing 
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APPENDIX  B:  TEST  CONDITIONS  AND  RAW  DATA 
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•n  ry  lA  /<v—  i'V'/M-n—  t><N«  f  flN^^O/H^loO-A^Nrf'N 

ijiTi  iliiiitTt  iTiij  —  iiif  ■  —  1  n  (  T  iiiii 

I  I 

I 

Anft  NN  N  <v  |HO  NONNOOWNNrt.TiRRfy  hhmmO^i^ONhn  O  «0  O  <— 
lli|*lll  I  1  it  -»  I  *  I  I  I  I  I  I  I  1  I  111  I  1  I  I 

I 

«>•  —  *•  +  +  +  *o  *  A  +\  -o  +  **  * r*  +  ■*  +  -r 


-  i  ^  l  *-  — 


A*  *\VN«5i\i<\jO'*©a-.o©«v/'C  —  fv  —  00-*<M©f-<Si«.<'4«v©*VO< 

*4  III  I  I  I  I  —  I  I  II  II 


III  I  I  I  I  I  I  I  II  I  \ 


I  IIIII  lllll  I 


^  -o  o  <>  ^y?  ■*-  •*  o  <q  < 


N»N-Nfog(Jp<0-Ort-O^OOrtOfOOO-(MOrt(\)-ON«t’lH-trtn^N 

I  I  I  I  I  I  I  II  II  I  I  I  I  I  IIIII- 


f*»COin'nArOO*jryOrsilA'i>04»O<M4A*V®0<3^iN^O-0»r^)«A-f<^l—  O  O  4*>  O  *)  a 
(V—  <—  —  -■*  —  <v  «-  *-  -*  TV  —  «  rv  ^A 


•  }  I  I  I  I  I  — 


II  I  — 


II  -  I 


OfrO«C)0'OtfOfOa'-N(0CffOM<JO(V5-NOffl^0'OOON-®CiOO4OC 


^rvni^vini\ry^((fM«ii 


O  n  «n  —  r-*  o  >n  ir  y\o  <r  roowoom  O  o  n  mm  urf>  -r  -o  o  ^  <v  o  ■#  —  cm  /  »  Q  o  in 

—  <V  ,*  **  .^  .*  ^  «^  •*  r*  I  —  m  —  'V 

I  I 

tf\-^Q©UMOOOOOOJMOO^J0O/vOOO^OO^J^©h-O/\Or^>  o  O  «  © 
fV  <n  <*i  #»■,  n  f*>  <n  in  t*t  tv  tv  i  rn  cm 


flON-3F-*Aso®»in>B«o  o  ^  4  >-o®o«Oin 
rtlMIMNnfy^fyNfvintMWiyr^^MAAiVwif^AAEyNni  —  fMNNIVM  rv  «  (V  •—  CJ  — 


4*O0«"A0NT10OOO-OO('l00'’0©0NO«"'<N0iNH\fyN4  ./■  ®  i\  O  O 
II  III  I  I  I  I  I  II  l  I  — 


.4  I4J 

&  ft.  wN-»n<— i\  —  'M-N-*(M"«f,y««fypAry— N  —  — 

Ml  >■ 


j  •*  «4  Cy  (N  C"l  rn  ^  -tf  /\  rfl  O  OrniO?>00-<-N\^fl  *  j  n  /.  4 


48 


CC**fCT  *C5 


lNSjRULTOA/WfHATo*  ST  AT  1UM  -  DISPLAY  EVALUATION  STUDY  -  TABUL  AT  1UN  Of  AESPONStS 


A  /*  ft 

I  :  1 


n  n 
I 


N  4  t  ■*  ft  M  "'4 
11(1111 


f 


/  f  ft  -•  A  A  A  ~i  ft  N  -«  N  *  A  -.ftvlNE-A.^-Pft—  >4ftft  —  -•  / 

4  I  (  l  lit  i  i  i  i  i  l  :  i  i  iiiiiii  ii*iii  »  * 

O  «  N  O  A  ft  /\  .ft  VTfl  ^  «  f  ft  f  J\  r  'V  o  "3  ft«ft->ft«ftfft4>J  f  C  **  A  _4  ft  -# 

ft  r  I  -  1  M  I  1  1  1  1  I  r  .  r  I  r  k  i  i  i  i  t  I  I  •  r  i  t  r  »  i  —  »  i  r 


ftj  4  «<\  4*  N  4  <>  4  -Q  ■&  SK  f  d  4  4  s  .a  <ft  -ft  P*  4  A  4  ifl  p.  <)  rt  vM>  4* 


ift  I  I  »  i  i  i  <  i  i  i  i  i  i  i  i  <  t  i  t  i  :  i  i  i  )  i  -*l)<iilttji  i 

i  i  i 


if«4d^Bhi'j'flOd>-ffO'l*3-fl  A  .n  «  O  o  *j  t  .D  r-  »  a  r-  r-  ?  o  ^  r-  O 


Z 

5 

ft 


4  <44NO^»%00  ^r4M*Y\'vft'4(VNr*>OQO(0(MON^>'4  0A40'4ONN^i^N  O 

till  i  i  i  i  »  i  «  :  i 


—  -  N0d/,VN.N0^O^->^0  NT 

||  I  I  I  I  II  III  I  I  I  1  I  I  I  I  I  -«  I  1  I  *  I 


•  r*'0*^-AO0'3i,sii-4OO*-CDO000OT‘Oo'M0-«‘00'NOOf^*-®O^i/'<V«ft®* 


4)  400  0  ^  A  rfT  <4  -#'ft'ftft>sfY»or^(ft  |  «>  Ki 

actD.oooa-j-Tj  3  o  o  a  o  ja("4o>a-J>  9?  'v  o  o  a  o  o  «m  —  o  a 

fft  f*(N'Nr'4<*'4rs4'“u'''4<M',<''l4  \  \  "Y  ^  (>4  ^  «  HN  -A  -*  ^ 


9  -4  w  n  ^  ft  ift  -t  r  44  4  d  ■•  *•  s  4  r  >*  o  t  -i  fv  n  *>  0  *  >  >  o  o 


49 


LTV  fSTBBf'T 


1 


* 

•X 

3 


3 

X 

w4 

» 

Ui 

a 


O  O  O  O  fflsO^'u'OJ'BOQOiA  Q  C  ®  /k  f  iA  0  O  - 4  i/\  .  3  O  «**  >f  >^Oo0^n>nQO 

(v  m  01  04  *N  01  o*  04  ./  14  *s  r\j  rvj  <m  <-v  n  ,v  M  '■'N  'O  ro*"/  v  *"l  <\»  ./  fl  nj  nj  i  wi 

. 1  1  1  •  T  i  1  1  i  T  1 


IlilllfilfrltJl 


1  «  «  I  I 


<  Ovf»OOOOOQOOOOOOOO  rf>000 

P*  04  ^  m  04 


TOOOQO’^dOOOOM'vQ^OOOO 

->  •>  04  O*  04  04 

I  III 


m  —  oii^oj—  rtOiAQO^oooomhao^ 

»*  -4  .*  r*  ~  .-4-4  l-I  ^  M  -H  —  04 


.  O  N  (M  O  « 

i>4  *»  m 


lNO-f  <rt(T«0  0« 
**  —4  -4 


<  0^ir04'J5Pjyli/t«f  04  O  4^  O  <3  >  irtP>»«04'®|N',,'Nlfc'0>'^O%OO(NiPi0(B»40> 

— *  rv  04  O'Oojp0'^(^O4fO‘0'0(Nr0r>M.^04(\4-«'^>'giT'fO  I  r*  — *  oj  4  ft)M»\r4NiV^i'anf>j 

I  I  I  I  I  I  I  I  I  1  I  I  I  I  I  I  I  I  I  I  I  I  I  I  III  I  I  I  I  I  I  I  I  I  I  * 


OOQOOOOOOQQOOOOaOOOOOOOOOOOOOOOOOOOOOOOO 


OQOOOOOOOOOCOOOOOOOOOOOOOOOOOOOQOOOO—  000 


•“•1C  ||  I— «*i  l-^l  I— •  —  I  |  ~  |  —  |  —  —  t  ~  I  •  I  I  I  |  |  |  I  I  |  | 

I  t  I  II  I  till 

wr*4<*j^«e>00— o-coopgi^00r*w"io/)0»r.  000-00^^  ftio.rvji^rgcn^fn^^r- 


X 

? 

V 


s 

3 


<0  «\NaOiAO'f'^Oe|N>J'I'i.  ‘aOmOS^'O^Bif.oOajD/'O^i'liiCO^OON 

N  04  04  v#  M«4  n  N  r*  04  >r  04  PO  r«1  /  N^nj(\j^nr4f'<r<jrti^i»i(\iP4iNirn(M  04  r>  01  ^  r> 


O0t4>r-o0000000000000^00000-*00000<v000000000 


C  C  .*  » 1  ■>  w  iir'V'iwuiNrgircCOArtir  ^  IP  O  iP  "1  -C  -O  ^  m  n  4  O  -  im  O  ^  g 

^  (V  P4  OI  ^9ftJ  ^4  H  iy  —  r\  (14  «  1*1  "4  (-4  <*)  ^  .0  »*• 


S 


¥ 

»4 

f 

-J 


o*  tn 

I  S  I 


aj  r*  ©  <y  */»  rt4^0ji\fy0','irM^000(VC^MP  b^^wmdid^iahiOJ'OO 

1  -‘-k—  04»n(0r»r0rtf\l0ir0r0f0crt0j  I  ro  rO  rt  O  -  M^fH(nrt^(\j^rN44(vONrtpi 

I  I  I  I  I  I  !  1  I  I  I  I  I  II  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I 


moorjir.  r«ooo^^'*^40000ai(Mj->^4'ri  oo  icj'/i»iMi0Q04'^N 

m^oi^Oi04oiY'r'<<r,,T''r^ 


O^C*4*>oOOOOOCCOOOOO*^OwOCCOOO«rOCOOOOOOOO 

N  04  •*> 


OOO 


0©OOrf'^000(D®00‘f'0®tnr-00*rNC  I  ^  N  if  (0\HMM<lJ\fl^CON 

Ti*s  »#  O  -f  4  ^  rO  —  —  po  |  Nf"  m  ^  ^  <n 

I  |  I  I  I  I  I  I  I  1  *  i  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  «  I  (  I  I  I  I  I  I 

00000*#00«0*>c®0®000'30^00^<-*0—0«pfc®tf\^'0»0tn00irim 

—  K»  rO  04  *“•  Oi  #n  *  H«  ,41  M  mM  rCi  m-  -*  O-  —  — ■  4“  ri 


0^0fl0^000o00CJ^'500r40^0«0inQ'<0'<0004(5H00rt^0x' 


Orjg  rO000Q0C3OOO00>4OOQ  —  Q  NOQOO©— *Q  ’f  30000  •*  o  o 

i  — «  III  I  I  I 


-f  NO^^mOO/iO^Oi/lOin  «  Z1  4>  ^  ifl  4  N  ^  O  *  m  N  w  in  m  r»- 


^  41  •)  44if“4\^«fir*Mf*iOCrl'0,i'll,,000^04'  ^45<)N4'®NPij3Ni/\f\jl,lO^*1 

llllllllllllllll-ptj  ^.«^i|||-piill;||«|  || 


Ul 

X 

* 


4V  a.  4"4*14«404»404*404  —  #y«-<V«~»'4-404~*'s4»«04M04-»04»*Oj^Oi44rV»“,,kJ^''>44,*f^<—  IN^N 

*  V 


X 

o 


o 

ft. 


50 


0A4ECT  AES  -7  6-2  1  o  -SB  0  34  -33  13  0  37  1 2  -9  ft  0  -32  II  0  -29 


m*"!  i*nn*rjsi<T  iNjosia  nwu  *tfu  oNisuno  own-) 


if  iMNi  o  n  ^  rA9'  » 

I  • 


30vf*?a3^v  3  JO  O 

V\  N-<^*MO-»M'4V%*V'4Nr  n 

I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  i  I  t  I  |  I  I  (  I  |  I  I  I  (  I  I  I 


■•  «•  (V  f  3.N  ,^.^0-*r3T»3  —  ai  O  O  •+  *4 


OOOOOOOOCOQOOOOO'iOOOOiOOOOOCOOOO'^COOQNOOO  o 

I  I  I 


qO  r»  O  fQ^»Nir>nonJnif.  -T 

*4*Vf«%<N<,Mf'4<«V«'jfvjcyrt<ry<'*r'*  VNNNN'NiVN  ^'VN'V'VNNNiv'M.N  NN'V'ViVtflt^  rsi 


i".  ^*r^r— 0f'*,r'iy10—*0'>j  O  C3>T'C7‘^J*''N  o  rg  c<  O 

<v  m  ^  n  ^  n  ^  ^  n  *1  **  -n  -\  v\ 


•  Orf\TOf^O®JOO  f  a  ^  ®  ^  -o  >  O  rv  o  r-  >  >OOU»rfVOO»P-«r»00*-AO*. 
»  <f  N  v  "1  V  N  <1  V  X|  V  -n  V  .M  V  V  v  V  N  N  N  N  O  V  M  N  M  <1  n*i  ^  AJ 


>rsim^Orf,'O®O»r»O^inOOOOOOj5OkrtOA4^v0OO0‘«''OAjQi^wi»^Cr»  T 

jNMN/nNrtniflNiTiojfONjnmnflmMflUNrtMAjNinrtiVfVflrvi^^M^niV  <N 


OOOOOOQOOgOSOOOdCOOOOoOOOCOOQOdOOQOOOOOQ  O 


AiAWS^O?  $  «*i  **  **  .ft  .o  o  -*  «a  ^  vt  •*  av  •«i  .>*  >r»  o  \  ^  ^  o  ^  ^  a  f  v  fl  o  >  v  .n  </\ 
/*  I  l  I  l  i  i  t  l  i  i  i  i  »t  i  .  i  l  i  i  il  it  i  «  I 


-4  m  N  IV  .»»  *1  If  AfiflflhM 


»  «-  .-g  a*  .«i  *1  .»  Of»f'K®?rOO 


■ 


H.1GH1  PAAtfltrtft  •  K«<D1NG 


a  ■/>j>^ooooov}.;>,/\oooo_>©  a  -j  q  /i  c  ^  ?o  o  c  ^  o  o  5  o  <t>  j  o  u>  >  >  .a 

J-  m  ^  l  h’Vj  r 

#Si  iv>  J><  *V  <101  *1  m  ,**  n  HI  rA  *1  A  n  "N  VI  *A  O  •%  (M  'N  A  'I  ^  1  I>1  M  '1  1*1  ^  iy  n  "1  IN  \  ■’l  rf* 

©A'/'¥'a«ni/‘»Oin<‘>GiAOtnc>0'AOOi/>OOOOOAOinoAa\AOM.<p*AO<Ani/i 

/N  W\  .3  r-  B  M»  C  ►  .tf  *•  .'  /  ^  —  ■*,  4  y  o  .o  r  f*»  ^  c 

.1  rt  rt  m  *i  <n  T  -fl  *1  ^  ^  *^  ,’i  n  vi  'I  ^  vi  ,-n  m  .*i  i-i  *i  i  <n  *>  <*1  a 


e  o  viooooooO'A  0j*iy"i1/>'vw'':DQ00Ojio~‘y'^'00*'io-*/'>..«»roo0ooo  "3  © 

-»  ^00trji--<3o>O'nGij®o0o  —  or  —  y  o  o  o  -  —  ooraca-n:*-**-*  —  —  o  •+ 

*1  •*!  r\j  i^i  i-*"*  <*i  m 


OrfirfiOQOQOcNtfiOwiOJOOOOO.AOCQOOOOOOtf'^rf’kO.noOOinOu-. 
^  NJ  h*-  ^  o  .y  «i  a  u\  oo-A>/\l/\f*-.rA  r  <  /i  ^  i.'  -*i  o  7  -3  «)  Jt  f\ 

IN  N  IN  fy  I\l  IN  N  ■'<  IN  fy  N  \  ry  (H  N  N  -N  <N  N  -N  N  fv  N  ^  <N  N  ry  IN  N  N  IN  y  .  <  \  IN  (N  N  ill  HJ 


O^O/iOV'^OiOOOOOCOO^iriAyiOviorO^COOOainO'lCiAOviOin 

l'J-'l«oa)^<1/l'r>N''yOBIC^r3)BM>/i/'i«r*0^0'li«J^,DiNl7,-'N 

f^(V<»Nr'4»N<V(V^v*N<NfM/v<N<\jfvyiT>/\j4rjfvjM«rj(^<\#tM<r\ryri-fVi*Nf‘ir^*^(\<rg<V4r4rOf\ji*i?n 

OiAO^CCO^Oi('fn?O^OiiiCi(iC,nOii'OCC  lOOiTOU'OOOi/'COCOaC 


«  Ounc-rfioTOOorvo^'O/ioo 


COOmOOCiAOOOOCiAOOOOOOOtAO© 
i»lWi<l/*l^»<^|Nil,l'N’l'*liH'»*,,l'f  r»/V,Ti*ln 

nrtrtii'nfliflifl.'i 


*S*  v*  /*N  *-)  rn  (J  ■—<%"?  i-N  m 

rt,(lmi'irti*iWr'lflivi*iHirNfnn 


OfOOOOtf,inO©*AOOO.AOa>iniriAQOO«tn*/w«i©OOeJ»nOi/,‘.AC>OOAOO 

^INlN<Vry'NfN'N,NMNfNiN<N'NiNfVrSiN^^.'NN<vrv[NfN'NrrfMrj'\(NrNf'jfN(N<NI\'N 


* 

5  . 


OOOOUliAOiAOiilOOOiil01/iUlilO/lO/-CQ»l*'0 
^5rwf-p-^^>r-»^r--or^r«»  o  J  N  s3  OOr-X^of-f-O  -  f» 
rtlfW(NfN(,jlV»N<N'N'NiMNN^f\ifV»V(NlVN.N''.  (N  N  CN  N  N 

©OOaOaOOiT'AOi/'iaOOi/'CJ'CU'O./Ii/'i/'OOo 
O'  Or-  £  ^  ^  -4  «  £  I>  rv  OJ  f.  oo—  O  <-~  r~-  a: 

rn^ryf«fg<N</\(«%*v^</V«Mtyyv‘<'><<vrMfv(r^csi?\4rviN-'>y"yrg 


AAAQOOn-OCOAOC 
r—  -0-or«,“**--CJ'r— f-r»r»-  o 
fN(NAjrn<Nfv<Ni\rynjf<(vftj 


oin^yiouwOiA/iOifiOO 

#:(■»  -C  «»* 


rf  ^o^QOO^'kroo  o  o  a  oqao*ai/\oooO  .r.iriaoGa-'*'-'-  e  ©  .*■•  o  o  «■  o  © 

«  «I  «  o  O  0  A  41  /i  o  ii  X43 

M  Cm  tst  *\  «V|  r*'  <M  •%  .• »  m»  IM  rvj  Ai  .O  •'y  rv  <v  «\  ai  <N  <\j  CO  nj  in.  rg  .>*  .v  04  rs»  <*g  rsi  r*  rg  r  i  a*  «m  <•*  r>g  rsi 

oaoocoo*^o^r)Oooo/'coiArtoow^o«*'Oooooo"«-^cJOooou^ 

*V«M<N,^ry»No<^fw^Oj^«^rN»f>yry«\»rvr(Nrgi\ir«y<Nlfyr<-N01<<\Pwrij('y^rs(fij(N*oj<Mrv<M«Vi 


«  O©O«AOAO</'OO©Atfi0OOOO.n»f»O«0G>OOAOir>a3c>rfi0.nOC5©OO«<-> 

f\*'U**W<\/r'V^»rs.r~r',*rg.«.(\j<\JAy  A*MV~r,>.'-\J(*.-<  -rr^  «M’liNW'NlN'N^^^^r.o<rN(N 

*<  «ooo©oooirr>ccoir»ooB,»o<r*/'OOfMOC'«rcrf'^  ocoocoooooc 

H  r»ii*i  iniyimnifini»ii*ini»ii’inifi*'fli<imnNi,iifli*imf<inrtioiOfi.'l«ci«in«irt 

*a  000*1*.  ©OQtf'u  C  OOOOOOO^^OH.OOrfNOO^^OOiT'inoOOOOOin 

<  ^inoooooo^incooc30«AOoo«rr.‘ooooooccM.i^ocr»oooooin 

•»  «■*  I-**  O  -T  *'  --T  **V  <"*  r*  ,~«  ,f  ./  fw  «1  J-  IN  I\l  7  ■/  l"  7  /  A  <*V  f  N  f  *1  n  ^  ^  #  IV  .♦  j  .0  V*'* 

^»NN(NNN^V'N«NM(N'ViNriiOi,<VfyN(\4rviN  %  *>.  *m  <M  ^  fy  i\  iv  ry  ft.  ^  '.•  r,  >%  iv  m  in  "Y'VJ 


qoqocoo  q^^coo^oooqooooo^'oo'/'i^oo^  o  a  vr 

/  X  O  O  -1  ,r  X  /  .‘lyy^/io*!  f 

m  i»i  rftr<.  m  m  m  r*i  hi  .•'i  m  m  i*i  m  i*)  m  r.  1*1  ii.  .■'i  hi  m  >i  fl  a  n  .▼!  *n  m  o  m 


Ov/ii/i.riAOooo 
O  <1  f  A  A  O  -T  A 
O  1*1  <1  fl  fl  *l  HI  HI  *1 


yi  yi  O  ii  c5  yi  j>  o  a  a  o  o  /  ji  O  o  O 

h«  \  /  ri  O  J  *•■>  ”v  *n  *>-,  rv  ~i  n  'N  -r  3  n 

«n  A  m  iA  -n  f’l  ■''I  ^  .vi  v  »i  .«»  *.  -,  m  Hi 

o  c»  o  9  c  oooooooooooo 


O  Q  A  A  O  ©  O  O  J>  0  Q  C  A  O  A  J  J  C  C  /I  O  '.1  ?  O  O  jl  tfi  y.  O  3 

im  *n  n  o  r  3  ri  .»i  j  ,/.»».-»#  «\*  -n  ./  «r  ’■»»'  --a  ^  .r  *»*  -y  ■'-  -*  *  ■*•• ■  •'  X  .f 

v  "i  .»)  *«  •*•  m  rr)  o  *\  -n  *i  •>  m  i’i  *1  *\  A  *i  10  iv.  ro  v)  «v> 


oodocoooooooooooct^o^noooooovoo^oooaqoooa 

OOOOC,  JOU9o~>00OQOQ<20OQC~O0  J  w  O  -  >  o  O  O-^  O  O  rJ-  O  O  J  O 

OOO-  ?O^OQ  ,-vOOriOOCCOOO«rc<*vOO  oocccooooocaooj** 

Owvo  -  -c  -V--V  —  JO  —  —  <  ^-*0 


1  IV  «  IV  «N  -  IN  - 


*V  A  ^  ^  ^5  r»-  >  ®  d3'0'00«h«'N\' 


t 

( 


CUNb  CLIMBING  TURN  LtVfL  TURN  DESCENT  UESttNuINC,  liM‘< 


'3J)flOOa3'OJfl30)lO)33i‘5M,*Ol  )  \J  3  3  3  C  3  O  T  03  1  3  ^ 

Xx<X3*'xNiNXX  X  X  X  X  V  M  X  X  A 


OAO>AQOOo  3  A  O  3  3  J  Q  ->O.A-0300©-*0.-\*A330A  3  f  3  33  *3  3  ©  A 

^^•>.*i»i,n->nnA-«inA«3nf*A«3  A-nAAn'nA’innnA'i-A  a  a  -3  ’A  *3  n  -3  n 


OOOOO  JWOXOOOO-A©  )00U'n0'3O'J0i33  AO  OOAOOOaO.-ja  o 


OiAOOOOQiAOaOOOAOO'AOOOOOOvAAOO'AO  30^0^  3  O  O  O  O  A 

(3  ^('j^|1<-4(j  rx  cd  'X  — 

<3  tfl  fl  rt  Ni  a  ^  mfl  i^i  m  rA  fA  f»"l  oj  rA  »a  A  #n  v) 


OOOAOOOOOOOO 030000  OQOOOOOAOOOOCA  3  0  0  0  0  0 
N  IV  N  ^  -N  N  ^  N  X  X  <N  >N  A<  EX  X  .X  Al  fV  "X  N  X  X  rx  «X  N  ^  N  ^  N  .W  ^  N  N  ^  -N 

0OOU"lOO0  30^lAOAOOA©OOA3<AOA0A0©©03Ot)AA.A3iA©iA 

*<yj>.0-a^<n  n  *)  jj  b  o  C  3  ?  on  —  O^aur-  o  y  r*  f  *> 

fX<X‘XfXX<X<X<X<N<NfXCX.‘X'X(X<XA*'X‘XfX<X<X<XAj.'XfXiX«X<Xf'<inx:N'X'X<x'Xrxrs,«4 


3  o 

r»  **» 

.->4  EM  r>4 


a 

a 


OOOOOOOOOOOOO-AO-AOOO^OOOOOOAOOOaooOOwO^OO 

.3  n  rt  rt  ^  m  n  m  .v>  (Ei  rfi  ,n  ,n  fl  ,n  f\  'T  Ei  ri  •’i  a  .1  ,f|  ->i  ,i\  a 


oooooeooomoo 

E'J«x^'*r-.-0«0^  ■* 

(O  f<>  |E|  n  l»1  n  '  I  IN  m  Py  fR  ,E| 


- - -  - - —  OOOOOQQOlT'OOQOOAOOOAO 

^JE>4— «>fr-^-<0^30c?'f'ro-fO'^— •vr^O-^'V(yf'3rjcOO'T»«-*”n,rM 
.■El  <e  ci  A  f<^  o  (fl  'E,  i\)  (*>  "i  cj  iE)  e\i*i  ^3  i*3 


^IM/MNIN40IM 

*3  *1  ,*3  <n  m  J3  pr»  <n  CA 


«n  AOQ0V»0OOiA0A0a»O00^O(A0>A0-AOcj0/30>A0rf3O  A0^  /.O-O 
-+  «4  X  -A  \  ^  N  r"*—r»N-M-'  '4.A  J  —  X  X  CM  X  X  "*-  \*  “  'X  -•  X  —  \4~J'\,,«  'JJ,  &  .-' 

\  N  N  \  N  IN  4  N  \  ^  IM  N  N  N  IN  N  3  N  IS  N  'N  X  X  x  X  <X  ^  N  N  N  ■  •J  N  N  'N  X  X  n  -A  -* 


AAJOOOJO  aoOO  3  3  O  O  V  A  .1  a  OAOOO.‘>00'X3  3^01%0|AOO«AO 
•■A  iA  ^  in  -/  *  a  „-\  >  rn-f'fi-rt-fnrf-t-tf'Tini  r  a  -t  *  f  ;  ^  j%  r  r  .1  r  e-  v>  j 
3  3  . vh  «3  1  «i  n  in  1  ’i  «\  .’l  e  1  .3  <i  «  ,’i  <\  3  >  »»  n  n  *3  •A  3  *t  3  t  3  n  .*3  3  -»»  n  “3 


CtrtRt  -J  RES  jb2  i  ii  303  iij  2v2  27S  32V  3!b 


1GHT  HAAAMfTE*  •.  ALT  iTlIPE 


OOQOOOOOvf'OO  O  O  O  O  O  "  <3  3  (1  J  O  N  o  3'">0‘.”>00'‘30Oy»y,A*0o''i 

'A  —  O  O  A>  7  o  O  O  '3  *  ^  \  3  ^  -•>  O  O  T  7  T  %  —»  O  .*1  <  H  rt  ^  H  ,-j  j  \  r>(  -  \  -O 

00  3  0  03-)-5  3  0  000o'»-3-3  00JO’J  J^U0  3CJ--0  3  3  >  3  O  3  O  3  3 
N  >V^  riin  i\  .y  i\|  ry  i\  ^  .4  m  *y  -y  .■y  ry  'j  .’ij  \  y  *>J  ■’y  >4  y  ■  y  *"•  y  <*y  .y  ■'y  4  y 


00000x5  3  O  'T'  5000000000000  3  00  0  00  300  0  OO  3  30000 

OOOOOJOO  >  3  O  J  O  O  O  O  O  O  O  ‘  3  -y  ^  O  O  O  J  O  i3  O  -3  3  ^  r\  m  .3  3  0  .1-3 

00x3. 3  OO  300  303-33033  -OOOOoOOO  3  30000  3  7  -Q  w  J  3  O  O  O 

(M  N  i\  ry  ,\  in  'N  *N  N  -\  V  \  \  ^  "y  -w  ,-«  .y  .  y  %  ry  y  ry  -y  'jiy'\i\ftji,v«y-«Niyfy<y.'yi>/ 

OOOOCO-noO  r-  C  OOC'O  OO  3  O  ■-*  3  O  0^00  Or-OOO  O  13  0000-300 
3  7^1^  7  7  yl  jT  ^  O  l"  I  3  /  y\  o  -o  7  O  At  <3  O  ^  -1  r  •*»  3  T  -A  4\  T  -A 

kfiu>iry>i3,y^»niox^t^ifT/'y%y^^yAyjir»y»j^y>  7  ^  ^  /  ,n  o  .t  ^  ^  in  ^  i/« 


<000000000  O  O  O  *3  C  O  OOOOOOOO  OOO  O  O  O  o  o  O  OOOO'/'sys^v 
<*OOO©0y00  :3  0<Ow3Qv»Os3O  3000  30000003  j  O  C  *1  J  «  O  O 
i>  O  3  O  C  O  T  O  3o0  3000o0000000000  03  3000  3030  3  0  0  0 
«(>ii\((sjry(yr4<\iy<yi\j.yr<i\iN<M<'j''J^iN(<yN'jN'yyfy-,viN<N«iy\,N'y(vr«'^iV'y 


OOOOOOoOfMOO  OOOOOOm/tOOOOOOO^  t>  O  O  O  u"  oOOAtOwtOO 
*TOi-yft-ftAtoOArji[yryry—AT  — 

ooo^y'0'c*oo-<ccr,  ooocooooc  <r  o  o  a  oo^ooco—ooooo  — 

AiA«Aj.d.M<\jiVAj(y(vj\Ag|N|X4ry(^rji^^r\jr^rg<vraAMiy'^rMNfti^jr^ogi\<\(ynlr^ivrM 

OOOOCOOC^OC  OOr“>OC*“OCOOC  <"■  00'“'00000<30‘">U'r'000^ 
0»n-cCCCOu'C  o  C  <->  C  OOOOOCOOOOOOOOOOC  —  O  T  C,  O  C  ty  O 
0^0^y*00CC»-CO00C00000Cr00cO0C00CC<‘j00oC/0<3C 
ry  f\i  ry  ry  ryAjpjiyftyryryruryiyiy  NfyiMf^iNfy«i\'<M'N(\j  ?y  ry 


4  O  O  O  C  f\j  O  O  <B  iT>  i/' 
(VNOOiMVC^NftJi^ 


I/'  CJ'OOO^C'O  7  O  C  kO  A*  O  a  a'l^CCOno^OoOOC  o 
ry  3  fNJ  »iO  C  I\j  iVi  M  iNj  C  C  Aj  A.  i*u  ry  'j  ,Sj  Aj  I',  «  |\  7  IM  7  Ai  C  O 

7%  /i  /  O  o  yi  yt  w.  y*iT‘>Ain«Aiy»y*'iiT»rii/\y>rwy'4^y''y'i/\*f‘»7\^(n 


OOOOCOOO-^kOOOiAOOCOOOOOCOOOO  o  C  OOOC-oOvAOOOOC 
OOOOaOOOOOCOOOCOOOOOOOOOOOOOOOOO©C».>0'yO«yO 
OOOOCOOOOOOOOOOOCOCOOOOOOOOOOc3  000',-i3'OOOf  o 

AA<N«NfS<ryfy'\rvjr7.yfyryr^fyr^^(yryry.NTyiNAfyi^'XtMlN<\<N,yfy('j<yr7f^iNryry 


000c0000ir\-40000t3000000i/'0<v00  o  4  Q  Ql  OOOOOOCOO 
m-T©A4A|AtA/k4.  At  7^77(M7(»WOi\<yii,'C7'0.'7rv(fl»»yiA'y/t<niA7,-fl4  7  t 
<30-*OCOOOOOOODOOCOOOOO  —  O0  33  303030  _*COT“—  O'*,  © 
7yryAj44ryryry<y<y(y.yA7ryry»ycy(y<yiy:y.-4/yA4<'yA,iyryryA/A4A4ry<yA<ry.ft«fyfy<VA7 

OflDOOOrnoOaraDOOOOOAtOOOOOOOCOOOOOOOooOOOOytOO 
AA^OOOO  _CiOm^'\\400  -  7  ■/  i\j  -  O  iSj  iT,  <7  O  3  ut  h  .4  c  7  \  >7  ^  ^  O  h 
O00oCOOOOO0O0yOCQ(700C3C0  700o0O>00e00y^-<0CO 
.NifMNiMNNfW-Nojrynj^/y-tijiyfvj^'yiy  ^  ^  i\  i\  N  N  —  i\  N  N  ly  -4  .-y  <N  1-7  <y 

OoDOOOOf^Ory*-*in^OOO—  OOrf'  O  O  O  Tt  '  OO  OOOOOOiAOOOOOOO 
7  oj  7  7  f  m  14  7  7  ''  7  i'  \  1  7  7  a,  7  —•  4  7-n  r  t  7  7  «5  7  7  y  <*t  7  .—  3  7>  7  .0  >o 

o^ooc  oooooooooocoaooooooo  OOOOOO-r*  O  <-»  —  «-».»  C  — 

rvr^r><n4(Mryryry<\4ryAiryrsA'\iryryrs/4y<'jr>y<M<Mry<\iryryiMiMryA7Ajry.'yA»MiM<Mry»VAi 

OOOOOTOOOAtC—  O  70  7i474i7ut47  TO  7  OkTvOOOOCOOOOO/".  7 
<o>sii®!Diti)-onaK  7  O  io  -o  od  m  ©xtox-coaxico  «  4  «  O  ixui<)^oo4c  a- 
<*  T-  O  T  yyy  yyyyyy  >>yyyyyyo-yyi><>yo'><><>7  yyyyoytciy 

000000000c00030000  0  00000c3  0o0000<3000000c>0 

Ay^COOOOOAJC'iT  O  0  7  O  7  4  7  O  —  >  O  C  «\  O  «3  O  O  To  —  700  O  3  C  © 

«-*(*y  —  ft-f——. -«—«••*  —  —  —  — •  —  —  —<  ft-4  .ml  ft* 

OOOOOOOOOOr-  OOOOOOO  C  O  O  O  <3  OOOCOOOOOOOOOOrtOO 
N4CO0C'u'ir70n.fiV77C®a'7  3  7  7  3  -TAtr-A.  OAtTC7A»;/tOAtO—  CO 
^  O  O  ^  n  4  X>  X,  X  .4>  r~-  />  y  y  7iAC4utin^ijT-4<  7  4t  r—  5  lA  3  ;  ^-A-A-lAOOc£A- 
*■«  TV  Ai  «—  —  — '•-«  —  <%  —  — <  —  r-t  —  —  'N  -  - 

rt  .7  <1  «. .  O  O  .•  O  ft  A.  A  /A  n  ft  Jk  A. ft-  *  •  Jft  O  O  O  f-1  r-  ft  o  ft  ft  m  rt  — 


O-^O—OOCO-CTO  -PC  7  O  "t  O  CV  0  ©  A  A  -T  oy  7  7  3  O  O  O  o  C  C  O  ©  ©  A>  O  -A 

OO  —  OCOr-A'OC  C  OOOOCO  —  04  <j  aj  O  O  O  O  C  —  <700  —  C«VCO^C<mO 

ooooooyooc  coyooc  o  o  0  o  o  a  o  c.  c  o  c  07000c  o  o  c-  o  o  c  o 


OOOOOrvOOA'OOTXvOOCOO  —  OOOw-vOOOOCOOOoCOOOO'vjOO 
''INiThAiiA^im-hO.AAj.'vj'.  T  Ai  Ai  <N  Ai  A.-  y  —  3  —  '  i  C  A,  A<  Ai  >y  Nj  Ni  rj  O  7  —  7  •'y 

lO  iT  l4  i/i  l/'  I  O  4-  41  if  it  7l  XT  W*  4l  4iA  j\  Ji  lit  n7l,ni/'\l'4J'i44^if  vfti1'\7i7lini/'ift7T7' 


OOOOOO  60000  *073000  0^0  OOfNiOOTt  OTGOOkAC  O  OoOOO  O 

^JAimO-yyiOi'y'NC'N  7-f7^AlOOO“yT  7  7  -T  O  7  —  »i  7  7\  -M  -*3  —  ft  it  77)  OOX-t 

OOOO/tOOOOOOKOOOOOoy-riOOytOOOOOOOyoTtOA-oOOOO 
^N^7rt707|N77"7  70  r74iNyf'H\7i'J/0,'0CMN«4'ii'4  37<i 

l\fy(yi\r7Aj(\jry(n:\jrjTV'Vi\^Mrj-i  y  \  iv  itj  N  'j  fy  \  •<  M  ",  i\  4  iN  >N  't»  n  \  W 

OrftOCOOOOzJCOoOOOOoOOi'.C^OyiOXOOOOOoOXvOOOOO  3 

4  (JO  4  O  u  4Njrt  ;  C07t7.7'*--i.3Ai^-377Cy£/-y  7  4  4  ?■  -  O  O  O 

joo^  J4?  3  J  ?  >  7  :  3'  t»  c*-  >  >  >  j  >yyyj-Tc>y^ryf*T7-0'>ooO3 

0r^0OO^-0OA--004>O0O0O70rv0f^yvAOXO70TOr^O-AC.A3^O-a 
0'^*OX>3‘CO7-aOyOOOOC.>OyOyy3LjTO<'AO,n-7‘TO^  —  y  —  >o<T 
7  4  4/7  741^7  /  4/  4444ifi44/4/-7|4  74174777474/4747 


•^*ry—  ry«-*ry  —  ry,— *fy-yrviAfVfty'>y»^<>wft«ry  —  f'/  —  iiy  —  ry» 


#•  ,h  aj  Ay  rft  o  7  T  y\  ci  -O  A  r-aj< 


1  ft*  ftt  f»j  «j  ^  n  7  7  4  4  3  Or-r-i 


CLIMB  CLIMBING  TURN  LEVEL  TURN  DESCENT  uRSCtNOING  ItMN 


4 


i  a  -»  o  o  o  o^x^oojjrj^nT-a^o.ii 

t  5  0  5  7  30  0  0  30  >  O  -joO  30  70  —  O^Ti 

0.7Jkiv7»O-iOw3Jj3^^3  33>  J23  i337-Oj.lj5.Jj  »  >  »  O  3 

J  X  X  <X  X  x  -X  x  X  —  X  X  4  X  X  X  ‘4  X  —  X  ^  \  N  X  4  X  X  X  X  -X  X 

0*000  7  O  x  “V  —  O  3  7  7  7  5  0  0  3—  3—000  30  000  v3  00^0  3  0  3  0  0 

(*l  •n<M^33«7'IV  4  4XXXOX4X  t  X  J  4'  O 

A  A  >  A  O  A  A  A  A  A  A  A  A  <>  A  A  A  A  A  A  ^  A  A  X  A  A  A  /AXS  —  -SAAJI  a  A  0  A  A 


■# 


O  A  A  O  G  <3  O  *  A 
N  M  «j  O  »M  N  -  —  -X 
AOAAAAx-'tAir 


>  O  o  3  n0>0>oao 

«  ,M  O  r^JSMX'NNflV 
iA  rf'  ^lAirt^iA^ifT^iTiA 


■0  G  O  o 

«-  Ag  X  N 
vrt  A  A  i/> 


O  O  J  G  -*  G  A 

—  cn  o  o  <7  *«  *■ 

■a  -a  o  #«  it-  a  o 


O^OOGOOT* 
—  —  —  a i  ^  o  >r  — 


QOOOOOOct  -O  JCOOOOoCOG 
rt  W  ^  H  o  o  .S  O  r«C^(WG0^3iA 

A  <A  vT  /»m/liA*3trA(A^A<OOAA^ 


•*  A  O  A  o  O  -*0  000«3  000  *0c00%n 

•t  -7  -O  45  -7  A  -C  .Ti  TNOAj^^M^ThiA  15 

A  /I  tf\  A  A  iT  iT  AAAiAiA-A^Iv/'OAi/'iAA 

^MXnaiHMRtaiMvtrtXHM*)*  —  ****** 


#^OO^^f3iT<  AGAAAOixOAG  —  OAOOOOOACJA.r.  OOiAAOOOOA 

QOOOOOOOOOOOOOOOOOOOOOOJOOOOOOOOaOOOOOOO 
N<'ilXNAlNN,'l  XXX  X  X  XX  X  X  -M  >j  X  •*  >X  .X  <X  -X  N  X  M  'N  N  N  N  ■J  \  N  N  M  N  N  X 

OAOOGOO'OOOGOQQOOGOOAOGOO'XJ-OOOQOO.oOOOOOOO 

m  -«  fi  o  o  -r  0  3  0-  3x0  —  r  x  ©  o  o  —  —  x  —  —  -i^ojjom-i  x  —  a  — 

0000000  3300000000  DOOOCOO  300000007-0000000 

<X  A4  Al  N  <X  X  «X  ,-X  <X  X  IX  .X  X  X  >X  fX  -X  >X  XXX-XXiXCX'XCX  X  X  Al  >X  <X  —  -X  .X  (X  NN  ^  N 

UJ 

a. 


5 


H 

C9 


■f 


0QOO0753A 
M  IN  aj  N  N  M  o  XX 
tftAA'OACiAAA 


c 

x 

A 


o 

X 

A 


3  A  3  G  O  O  O  O  3  X 
XXXXXXXJ  X  X 
A  A  A  A  A  A  A  A  C  A 


O  O 

X  (M 

a  a 

—  *N 


o 

A 

A 


0  0  0  0-30 
X  <x  X  -X  X  A; 
A  A  -A  A  A  A 


O  O  O  O  ©  3 
x  j  ~j.\j  —  .% 
A  A  A  A  A  A 


o  o 

7  A 
A  A 


O  3 
J  X 
A  A 


OOAAOaOAOAOAOAOC'p^A^a<OAOACO--XAOA<5  00QOOOOOA 
ff»  —  X  —  — •  — I— <0  —  —  —  X  —  »MfX-.  -40p-»fX*-0<rn<A-»* 

AAAOAAAA  AAAAA^TAAAAAAAAAAAAAAAAAAAAAAaA  aa 


* 

Os 

*- 

X 

v> 


0-X3fx0033*3  xOfXO.xC'XOXO'NlOAOAOxO’XOOA  xOAOAOAOO 
•nx-m-J  ■gv*4  t-RH-R'y.N'M-NX-*  ■*  X  ■)  —  —  —  —  -*lO  ^  ^  d  ^  4  •«  n  V|  <T  N 

AAAAAAAA  O  A  A  A  A  A  A  lA  A  A  A  A  JAAAAAAAa  O  A  A  A  A  A  A  A  A  A  A 

^  ^  —  —  —  —  —  —  —  —  «n 

4  O  3  O  G  G  G  J  f  _  »  -3  500C30004.000  >-#00030000000  0  0  0  3 

a-oaoaoooooaoooooao^.  <3  r  ~  -  *  *  **  -  ■*  '  *  -  -  --  ~  -  *  -  -  -  - 

‘  i  A  7  A  1  <\  *1  A  3  "  - 


3  OOAAAGOAA  O  3  /*-  3 

*  '>«%nn-3AA^'>'in-n,n 


—  (X  "*  <N  —  X  ■ 


X  —  x  —  -J~»X  —  X«**X  —  X  —  X  ••♦  X  —  X  —  X  —  *« 


x^n  *■>  r  -*•  a  -/'  o  c  ^  im  tj  j>  >  ?  o  ci 

~*  —  —«■)"*■  —  X-N  —  —  -I  —  ~C  -M.^XX 


57 


CORRECT  RES  360  lt>oG  iiiS  iS?0  2010  2030  1S-.9  151b  16<0  <^00 


H  ISMJ  PARAMETER  •  VERT  VEC 


U 

* 


s 

D 


*- 

z 


z 

a 

z> 


-i  uj 

a>  a. 
w»  >• 


O  JOOOOOOOOC-AOO  O  O  O  O  O  3  •  »  *  O  O  9  v>  />  -I  O  O  ■ »  O  r>  ^ 

Jl  f  y-\  .it  o  «A  O  P-  O  A  A  O  O  / 

rt  n  #  /  i<i  n  -1  ■i  A  rf  .ti  •<  .n  i  n  ^  i  fl  ^  l  r  1  1  r  n  rn  ci 

I  l  I  i  I  I  (  I  l  i  I  <  i  I  «  i  «  i  i  i  i  l  i  i  i  «  i  i  (  i  i  < 

0000000-300900000000000000000(300009000000 


>  O  J  o  C  3 

J  n  j*v  O 

>  n  O  rl  r\  r*l 


I 


I 


I 


OOOOOIOOOOCOOOOOOOOOOOOOOOODOOOOOO«nOOOOOO 

*  D  04  O  N  4  O  A  -I  4  iAi40.\iLi/'^^aj4'J4  Cl 

Vi  «-»  (N  —  —  N  PJ  N  Ifl  -»  <n  y  ng  «— 


O  O'! 


oooooooaoooooooooo^w  — 

444  S  O  X  .A  O  D  b  .o  B  &  u'iO>n9O<D0x}J3V7>i>tn'-)«n  u  oj 

Ti^  .a  ia  m  ia  r  ^  r  ift  a  o  ^  1 1.'  ^  4  j*  /v  •*  j\  t  »r  ->  -i  -t  j\  r  »a  r 

ii  l  i  i  I  i  <  i  i  i  i  i  <  i  i  i  i  i  i  i  I  i  i  i  i  i  i  i  i 


oooOoooocooqoooooooooo 

OOedOd-OV^DsAT^  DPJ04^0^0<J'-ZI 
'  *-**•■*  -  *  ^  r  .n  ^  Ifl 

*•11  «  i 


£  OOOOOOOOOQOQQOQOOOOOOOOQOOCOOOOOOOOOOOOO 

Pw  —  <A  Cl  -X  A<  >  A  p>  CO 

•  I  II*  I  I 

4  ©OOC<“,OOOOCOOOCOr'CW  ooo^oooac  coooo—ooooooo 

^4^k^,/(4irir^-liA'OtAiOinui4^iriAi^i^iAir<r  r  fy>  m  q  ~t  r\«  ci  -a  u-  o  o  ^  ^  u-'  »a 
i  m  rt  n  r>  I  —  <*lp*.x*f  t  ^  N  /  n  mm 

♦  »  I  t  |  I  I  »  |  I  ll  l  I  l  I  I  I  l  I  I  1  I  1  I  I  I  1  I  I  I  I  I  I  I 

<b  oooooooooc  oomooaooooe  o^coc.cooooococ»ooooo 

—  4  o  iP  *)  ®  x  —  »  a,  t  a.  -a  t  x  o-  o  <b  <v  ^  or  o  r  x  xj  p~  .-i  x  C  A  o  x  c  <x  C  ir-  <c  u\  ay  x> 

u\  i/~  <m  m  <r.  •#  <n  n*  io  ■■  a  >n  ^  ^  in  ^  fc*'  ^  x'  if  "i  m  >/*  »a  ."i  r 

I  I  I  l  I  I  l  I  l  «  l  I  i  l  I  l  I  l  l  i  i  i  i  I  l  I  i  i  I  l  i  i  i  i  l  >  «  i  I  I 

<  ooooooooocoooooooooocooooocoocjooooOooooo 

<-4  «lOON^^OD440^<9"<0009>C4COiM'NI]'7lCOOO^^'f4  Psl  O  O  O 

M  n  ^  M  f*j  ftj  M  «  rj  •<  .j  «  *  rfl  .\  — 

I 


©ooeoooo 

w> 


OOOOOOOOOqOiAOiriOOOOOOOOOOOOOOOOQO 

*  <°  tt  *2  ?  2 


OOOCOOOOOOOOOOOOOOOoC^OOOOOOOOOOi-4-OO 
OQ«O,14irnJ4OOOHCiA(p>4rtiANi0  nr  O  N  ^  id  ^^>04 

“•  —  —  -4  —  _•  _  IN  PM 

1 


o  a  o  o 
Gc  44 


OOOOOOOCOOOOOOCOOOOOOOOOOOOOOOOOOOOOOOOO 

o4oo6»on  r  ®  j«  o  o  c  c  a  o  o  o  a  c  m  4  g  4  ?&^040r*a*o  x  »n  b  g>  -o 

NP4-ir4r4r^iN^rg  ^-A^i'iPKn^rv'NPjwnNPiN^fNN^lNjNHiN  .VPJ  «■  (M 


z 

O-C  OC-OCOOOOOOOOoOC.OO^OOCOOOOOOC.OOOOCOOOOOOO 

—«  •—  rf>ooo«-CO«^o4^i/\<4i**c^iri(N30OC  BOQ74i4f»uinifi44CiO'*iirini4p* 

•*  I  I  t  I  I  I  I  I  I  I  i  I  I  I  I  I  I  I  I  I  I  I  I  I  II  I  I  I  I  I  I  I  I  I  I  I 

* 


oooooooooooooooooooococoaoooooooo<nooo'4*oo 

?  4  G  ?40Nt0'V44ir''P  -X  O  c  lA  <A  in  O  /  tfPnjJ".  «T  O  4  O  4  i4  AJ  D  4  4  Pa 
V  !*>«/*■*  f*4  ■*  rt  m  (N  t  IN  -X  AJ  *«1  -X  m 


OOOOOOOOCOOOOOOOOOOOOOOOOOC 
IT  OO-f  o  O  O  —  C  O 

I  «/•  I  «  —  —  I  —  -- 

III  I  I  I  I 

•  Ccot^rfiocsa.  o  <©  o  —  -  -■ 


OOOOOOOOOOOOO 

o 

p* 


4  fN  14  (N 

■  I  I 


v..  *_  w  o  a  w  w  c  LjOGiOui-'iyww 

C  400S«.  OfflOU*.UCG®On  OG44  4I  4<r« 
«N  r4tTifl?i^l4«4.Nin44'Vl/'"''P  m 

I  <[  I  I  I  I  I  I  I  I  I  I  i  I  I  I 


vOwOCOlTOCIOCCO 
'(T«ry|li:440iri0«0 
If.  IT  fM  (M  1.1  T*l  f*l  x  ffl  I  s AX 

I  I  I  I  I  I  I  I  II 


oooooooooaoo 

flOUACODDDOBBC’' 

n  /i  *n 


oooc-  ooooocoooaooooooooooooooococoooooooo 

444COP4C'bC%OJ  OLJIIlLSDiXBaDI/EII®  O  O  v"l  O  L  B  O  O  X  B  t 

l 

OOrjOGOOOCOOOOOOCOOOOCPOQOOOOOOO 

(SJE4D44  4E®oq  OBoCD-BIIIDPmO  0  4  4  0  4  4  D 

»fl  <11  i|\  41  i/l  rfl  <1  iH  ^  i(W.  ^  i4,  ^  lA  (A  <N  lA  IT  i/l  ifl  rfl  4l  i4  /■  /l  'O  /I  ifl 

*  OOQOOOOOOOQOOOOOOOOOOOOOOQOOOOOOOOOOOOOO 

Ay  PM  IB 

I  «A 

I 

43  oocooooocooooaooooooc-oaoocoooooooooooooo 

|MI\Uffis40S4^Oou)4CGl.b4«'S;4i)xi44OSl  )4uGcJ)44)jr 
Cl  ^  i/i  (T'  A  A  A 

-*  O/'OOOOOOOOOOOOOOOOOOOOOOOCOOOOOOOOOOOOOO 

—  r  4  o  m  o  f>*  *■  a  a  o 


\  Pm  ■—  '"M  —  Vj 


—  —  rS'N'Am.f-X'AAB  4i  r*  x>  D  J*  roc.— 


«MPi  .1  X  »  4  i4  X-  O 


s  x>  O'  o  o  o 


58 


CtHUCCT  «£S  -12  560  4a  5fiO  5bC  -S80  -60  90  -1 66  ^40  120  0  120  -560  -360  0  -5b0  64  0  -«.5e> 


►LIGHT  PARAMETER  -  VERT 


| 

} 

i 

l 


1  1  -5  J  3  *?  O  >a)33^jaOOO)O^OOaa)03lOJ9J  >30503**  50 

J  vA-«0  0J0  3«aN3./\  a/OMOoOrOO 

ilifis  •  ii  i  i  i  iiiii  1  i  i  i  i  i  (  i  •  i  i  I  i  i  i  (  i  i  i  i  i 

0000  500  3  0  0  3  0  0  iOOOAOOOOOOOOOaO^oOOOOQOO  30 
4  -A  O  O  3  A  J3  f  f  3  O  O  O  O  -•  O  Q  .A  a  ->  J  A  tj  V»  3  O  A  A  3  J.AO*  5  .A  -»  0  A  * 

•A  *  A  A  -A  -f  A  A  -A  f  f  .1  A  il  A  A  /  A  fl  A  A  .A  «A  A  -A  r  -A  A  A  A  A  A  A. A. A  ■*>  •*  AV  A  A 

{  I  I  I  I  I  I  I  t  I  I  I  i  I  I  1  I  I  I  I  I  I  I  I  ■  I  I  I  I  I  I  I  I  I  I  I  i  I 


o 

<) 

A 

4 


* 


O 


OOOOOOOOOO  5  O  Q  -A  OOOOCOOOOOOOOQOOOOOOOOOO  o  o 
#  rfVJO.B^lJA'MCOJ'-OTJOr/VOOOOOOOO-AAjJO^-OA^^NOO'^O'AO  O  2  TJ 

J  i  (\  kf>  N  A  f  sPy  S  J-  I  -*\J  v/\  -T  f  /|  /l 

^  I  I  I  I  |  I  I  I  I  I  I  I  I  I  I  I  I  i  I  I  I  I  I  I  I  I  I  I  I  I  I  1  I  I  I  I  I  I 

x  oaoo'AooocioC'^oroooirfxooooc.ooooooooao  —  ooooac. 

03  A  vA-SOaJOOOO-AO-A  O  O3'C«OOQ«O'0^^O<ftO^O'-j|AO->»1i)O3' 

<*)  —  ^  <>0  n  n  M  -N  f\i  <*M  <**\  ■'•J  --  m  N  M03  3  •"  *N  r*  n go* 

»A 


OOOOOOOOOOOOOOOOOiAOOOOOOOOOOOOOOOOOOOOOO 

»AOO^Oa04>A-f»rAA<-«000-/''300aJ^^>*,,kOwA^O^A*N3)A4rf\»Ml>^\J. 
1-4  ^  H  ft;  f\  rvj  >#—  *■  •' A  •>*  -•  -•  A*  —♦ 

I 

OOOOOOOOOOOoOOQCOwOOOOOwOOOOOOOOOOOOOOOO 
r-  W.  -5  C  ^  3  O  -A  =  O  A  >  ^  A  5  o  O  -A  JA  3*TjAj5.')'>'30jan^  O  O  A.  O  -A  «M 
•*4o-'NNNiN.s|rf^,<,^Ht^<MA  f  >3  f  A  A  ^  A  •«(  A  (\l  <M  f  ■»!  n 

I  I  I  I  I  I  I  I  »  I  I  I  i  I  3il»S  • 


000-3^0  0  0000000 
o^ifli>o  JiT  f  ams^'y 
♦  *n  -a  ia  ^  ^  -r  *  n  .n  a  *\  m 


ooo^ooooooaooo 

««<OOajcCit04)aBO/>x.* 
■A  VA  «A 


OOOOOOO-AOOO  oc 

3  .A  “>  X>  O  5*  3  N  O  -®  A  -I  Q 

.a  a  a  *n  *  *  4  -r  <n  -r  <r\  ■* 


00000000*3  0000 
DO(m)B«ifl«(ua)  cajio 
iA^3Mr^in3'/i^'4'iT3MP 


O  O  Q  O  3  C  O  O  3  O  O  O  3 
30  a 

■t  *  (**  r  *  r  r\  -h  a  ■/  in  ^ 


OOOOvAOOOOOOOO 

VQnO'TOOOVSO^  X>  A 

«/aiA«a  ^  ■3ino^ir>A«»in«‘ 


ogoOOoqoooQOoooaoooooooooooqoooooooooooo 

4a3>SDA3i3af0O.J^a.-a34JSHS0«40Od^3o0i3O0Ai3n03D 


OOOOOCOOQOOOOOOOO  3  30003000^  3  O-AOOOA  300000 
*  50  4  JA<*1  OnOOAj  no  O-AOnABOJaO'J-j  A  A  4-AO-»^'.  A 

A  -A  Ml  —  —  a  —  I  I  ^  —  —  "•I  I  I  —  J  II  |..>3l|M  I 

III  I  I  I  I  I  •  I  I  I  I  I  I  I  I  }  I 


TOE-  OEE  0<5 1  ?•>'-  '-(i-;  084  034  -■(?-  533  U  3**37 


S~  to 
TO  -O 
*M  C 
0)00  0 
E  _  <-> 
•«-  E  <v 

)—  O  OO 
S-  *— H- 


u 
<D 
S- 
S-  cO 
O  C V 
<_J  cn 


o 

CM 


CO 

O: 

CD 

S- 

CD 

CD 

“O 


CD  00 

«—*  ro 


to 

<D  to 
GJ  OJ 
S-  <D 
CD*- 
0)  CD 
“O  <d 

TD 

CM 

CO  CM 

+  * 


CM  CD 
CM  — ' 


CO 

(D 

CD 

CD 

O) 

to 

s_ 

S- 

4-> 

CD 

CD 

o 

CD 

<D 

c 

T3 

TO 

-X 

»H 

»D 

ID 

4* 

*-*4 

r*H 

o 

CM 

<D  CD 
CD  <D 

4-  4— 

OO  CO 
UD  CM 
CD  LO 


t/>  CD 

3  Sj 

O'H- 


CD 

s: 


“O 
CD  <D 
x:  *-* 

-M  0) 

> 

4—  <D 

O  i— 


c 

<D 

E 

cn 

cd 

tO 


O 

<3* 


<D 

<0 

TO 

CJ 


■o 

c 

03 


c~ 

<D 


o 

4 -> 


tO 

CD 

i 

S- 

X 

CD 

OJ 

JZ 


4-' 

<D 

o-* 

4-> 

i_ 

sz 

TO 

S 

C1 

CD 

4-> 

•r- 

CO 

“O 

r— 

to 

03 

4- 

CD 

CD 

CD 

CD 

JZ 

C 

4-> 

-C 

4- 

4-4 

e 

O 

o 

CD 

CD 

c 

s- 

,c: 

*r— 

4- 

+-> 

ZJ 

<d| 

r— 

QJ 

QJ 

TO 

tdI 

— 

S- 

> 

PI 

O) 


<D 

2 


03 

JT 

3 


CD  • 
13  O 

cz 


o  VO 

CM  CO 


e  e 


o  o 
00  o 
00 
4*  * 

ID 

+ 


_o 


o 

qj 


4- » 

5- 

.■a 

4-J 

CO 

CD 


4-J 

03 


<D 

CD 


TO 

TO 

"O 

4-4 

u 

U 

CD 

, _ 

4-J  O- 

't— 

CD 

TO 

T3 

C  4J 

i- 

C4 

a* 

o 

•r-  JZ 

CD 

CO 

4- 

a> 

s- 

O  CD 

E 

S- 

o 

CL 

a.— 

13 

•  p- 

to 

c: 

c 

TO 

to 

■r— 

QJ  4- 

CD 

•  " 

JZ 

E 

r— 

f, 

TO 

OJ 

—i  QJ 

=3 

TO 

<D 

<J 

CD  40 

E 

■r— 

i- 

C 

O  4-> 

4-4 

4-4 

4-4 

TO 

4-> 

X 

•f— 

X 

JT 

4— 

TO 

c 

CD 

0) 

CJ 

4J  O 

E 

*r— 

> 

c 

CD 

<D 

CD  4-> 

CD 

CD 

-C 

cl) 

JZ 

E  co 

-C 

JO 

4J 

■C 

4-> 

CD  QJ 

4-4 

4-> 

4~> 

CD  S- 

<D 

CO 

co 

to 

lO 

S- 

t/1 

TO 

CD 

TO 

TO 

cD 

TO 

3 

4->  SZ 

£ 

X 

3> 

SI  4-J 

+-’ 

CD 

4-> 

4-4 

4-J 

4-» 

TO 

■»-  i_ 

TO 

TO 

TO 

TO 

JZ 

r—  O 

sz 

JZ 

JZ 

3 

4-  4- 

3 

3 

3 

CM 

t”0 

U1  UD 

61 


+-i 

5-  1A 
03  'O 
+•>  C 
CD  c/“>  O 

e  ^  ° 
*»-  E  <U 
I —  O  V> 
s-  - 


to  to 

i/i 

l/l 

<U  OJ 

a> 

o 

<✓»  </> 

c 

<U  QJ 

a; 

cu 

4-3 

i-  s~ 

s- 

S- 

o  o 

4-3 

E 

cr>  o> 

cn 

cn 

c  c 

<D  <D 

-'v. 

a;  oj 

<u 

a; 

j>/. 

cu  a ; 

4-> 

T5  -o 

xj 

“O 

VO  o 

<+-  4— 

4- 

o  o 

IX) 

o  o 

oo  O 

O 

cr> 

» 

VO 

r— 1  LO 

o  o 

+ 

CM 

CM  LO 

CO 

<d 

i.. 

4—3 

o 

X 

4- 

CT) 

<u 

•r— 

-O 

s~ 

4-3 

4-3 

VO 

•r- 

3 

*»0 

t/l 

rt3 

cn 

? 

c 

•r- 

“O 

c 

03 

<o 

CD 

jC 

cu 

c— 

4- 

cn 

o 

c 

1 

fO 

CD 

1  3 

■ — - 

(— 

, — 

1  03 

o 

;  > 

c n 

<V  • 

Z3  O 

02:  — * 


CO 

•  r- 

a> 

CO  |r— 

•r~ 

6 

cu 

U 

e 

X 

(1) 

(U 

X 

•r—  4-> 

a> 

x 

X 

4-> 

c 

X 

4-> 

4->  r- 
4- 

<D 

QJ  <D 

cn  4-» 

4-> 

VO  c** 

</>  4- 

c  u> 

to 

no 

CO  o 

Q) 

ra  -f- 

<0 

32  4- 

a> 

?: 

S-  tO 

c: 

> 

4-3  ■ - 

*-3  (p 

4-> 

4->  O 

4-> 

rO 

fTJ  > 

CO  <D 

rt3 

x  u 

x  cu 

X 

X 

X 

32  O 

3  — 

3 

3  <0 

CM 

m 

UO 

VO 

CLIMB 

(continued) 


66 


p 


CLIMBING  TURN 
(continued) 


V-  Ol 

TJ  T3 

4->  C 

a.’  oo  ol 

UO 

CO 

o 

o  o 

»—4 

\C 

B 

CD 

CO 

CO 

o 

CO  ’ 

<3- 

CO 

•1— 

E  QJ 

F— 4 

T  ■  1  1 

1 — » 

O  CO 

d  --- 

U- 

oi 

Ol 

ol 

Ol 

CJ 

CJ 

O) 

QJ 

d 

0*1 

QJ 

a> 

<u 

QJ 

Ol 

03 

•f — 

<u 

d 

d 

d 

u 

4-> 

4-» 

4-1 

E 

4-J  oi 

CT> 

cn 

Ol 

cn 

o 

o 

CD 

o  c 

<u 

<D 

QJ 

QJ 

d 

d 

QJ 

4-> 

qj  o 

T3 

“O 

■a 

M- 

>4- 

d  CL 

d  Ol 

CO 

o 

o 

rH 

o  o 

o 

o 

O  CD 

rH  • 

CO 

UD 

o 

uo 

uo 

o 

o  cx 

+ 

+ 

CO  O 

<o 

CO 

■ — 4 

00 

uo 

uo 

r-4 

4- 

to  CJ 

qj  a. 

s 

13  >> 

CO 

•o- 

•  4 

OJ 

CO 

<3- 

O'*— 

] 

4— > 

E 

-d 

O) 

C-* 

o 

cn 

■3 

Ol 

d 

«4- 

•r— 

c 

c 

l+- 

o 

o 

o 

*4— 

u 

•r- 

d 

CJ) 

<b 

4-> 

o 

c 

a) 

Ol 

03 

■r- 

■r~ 

XI 

u 

4-> 

d 

4-> 

o 

•f* ' 

«r— 

c 

T— 1 

“a 

O) 

C-* 

•r“ 

4-> 

c 

cr 

4-1 

Ol 

3 

4-1 

■  r“ 

<3 

d 

QJ 

o 

Ol 

d 

0J 

JQ 

xi 

d 

crt 

4-1 

E 

cn 

•  r— 

c] 

cr 

QJ 

3 

M- 

•1—  1 

CJ 

QJ 

XI 

o 

“O 

xc 

Ol 

4-J 

d 

aj 

05 

4-J 

- - . 

XI 

JZ 

QJ 

aj 

4-1 

• 

4-> 

4-1 

JZ 

d 

XI 

<u 

U 

•F— 

4-1 

OJ 

0J| 

i 

c 

4-1 

■91 

O) 

1— 

•r— 

Ol 

Cl 

w 

cm 

-C 

QJ 

0) 

•I— 

0J 

CD 

c 

■kJ 

{V- 

? 

tu 

CL 

UO 

"3 

’P— 

c 

o 

Cl 

QJ 

Ol 

r-H 

1 

£ 

d 

f— 

Ol 

“O 

XI  1 

3 

L. 

13 

1 — 

« 

o 

r— 

4-1 

T3 

•  1 — 

4-1 

4-> 

r— 

c 

<T3 

*r— 

u 

CO 

«r— 

o 

QJ 

<Q 

4-1 

•r— 

Cl 

d 

c* 

r— 

d 

4-> 

4-> 

•1 — 

ro 

H 

13 

4-> 

E 

Ol 

aj! 

cn 

Ol 

3 

<4- 

a; 

QJ 

C-F 

w 

> 

a> 

E 

o 

-C 

CJ)  0- 

1/1 

F» 

XI 

U1 

d 

0- 

QJ 

XI 

CVJ 

cn 

X 

d 

•f— 

<D 

o 

cn 

•1 — 

^5 

o 

x: 

-d 

1 

o 

•F— 

QJ 

JC 

E 

u 

f— 

XI 

O) 

a> 

QJ 

<T3 

QJ 

QJ 

03 

JC 

CJ 

> 

QJ 

QJ 

CD 

XI 

-d 

•f— 

4-> 

JZ 

QJ 

XT 

-d 

4-1 

4-1 

4-1 

4-! 

F— 

4-1 

4-1 

C-- 

•»— 

QJ 

JU 

Ol 

o« 

Ol 

c 

d 

Ol 

o 

or 

ol 

e 

c\j 

«T3 

4-1 

«3 

•,— 

QJ 

TJ 

•4-1 

n3 

<T3 

•F» 

5 

d 

£ 

> 

5 

r— 

T3 

QJ 

d 

o 

C 

4-J 

c 

4-J 

OJ 

4-> 

4-> 

E 

4-1 

4-> 

rO 

fQ 

m 

03 

4-1 

fD 

•r— 

C3 

03 

a> 

XI 

OJ 

n 

<4- 

XI 

-d 

_d 

-C 

-d 

Ol 

3: 

03 

3 

3 

QJ 

3 

3 

4-> 

o> 

4-» 

OJ  • 

, — 

O  O 

• 

d. 

cr2-|  — « 

OJ 

CO 

uo 

UD 

I-  in 
*3  XJ 
4-*  C 

a;  10  o 
E  u 
•r-  E  GJ 
H  o  in 

t,  — - 


1/1 


<b 

4  J  «/) 

o  c 
Q!  o 
s-  aJ 

i-  in 

o  cd 
o  a: 


in  <b 

?3 

cr  h— 


cx  - 


O' 


<Jy 

00 


«-♦  O 
»— 4  r^* 


O 


to  o> 

d-  f-H 


in 

in  tn 

in  m 

a> 

<L>  QJ 

Q)  04 

c  c 

QJ 

<D  QJ 

Q>  <L) 

•7—  *f— 

i> 

i-  t- 

S-  i- 

4-J 

44 

E  E 

cn 

cn  cn 

cn  cn 

o 

CD 

v.  v 

a* 

OJ  QJ 

a*  a; 

c 

a) 

•M  4-> 

X> 

X3  T> 

•O  T3 

t*- 

*♦-  <4- 

^  co 

co  cnj 

no 

o 

o  o 

1 

4-  co 

CO  *T 

o 

o 

o  o 

< 

o  o 

no 

C\i 

oo  co 

* 

*»  * 

IT' 

in  in 

=>  X5 

QJ 

f-  CD 

o-- 

_C 

3 

4- 

44 

O  ” 

l*- 

r*:  ■#— 

O 

4- 

—  -*-> 

o 

co  cr 

r— ■ 

z:  o 

<D 

4- 

»-•  u 

> 

r— 

O-. 

—i"' 

a> 

rj 

4-> 

o 

• — 

4= 

c 

a> 

0-. 

CL) 

4-» 

E 

XI 

s- 

in 

cn 

04 

o 

X 

04 

04 

4- 

•v— - 

in 

CL 

04 

4- 

in 

— 

40 

CD 

aj 

x: 

u 

4-> 

-C 

44 

TO 

in 

3 

o*» 

c 

c~‘ 

•t— 

*o 

e— 

c 

■r— 

04 

44 

O 

*— 

X5 

t- 

•d" 

CJ 

o 

TJl 

1  3 

04 

i — i 

r— 

s- 

QJ 

04 

4-> 

>1 

cn 

a» 

QJ 

i 

c. 

<*- 

c: 

o. 

4-» 

«4- 

<T3 

o 

TO 

in 

O 

-C 

u 

n? 

m 

o 

•r— 

in 

x 

o 

04 

n? 

cn 

QJ 

3 

4-» 

E 

cri 

c 

E 

a: 

QJ 

cl 

4-> 

-/— 

QJ 

cx 

•r—  ! 

in 

4J 

i- 

•» 

>-» 

X3 

<D 

U 

4-> 

04  1 

3 

X 

<T3 

X 

! 

o 

a» 

<D 

O 

4»* 

QJ 

<U\ 

4= 

■ — 

in 

in 

QJ 

OJ 

*o 

41 

-c: 

QJ 

0J 

QJ 

o, 

JC 

-C 

x: 

4J 

•»  n 

i  *M 

4.> 

l  > 

o; 

U 

oo| 

in 

W- 

in 

r*.  i/i 

l/. 

1- 

C\J, 

.  <v 

<V 

i’T 

•c 

04 

X 

C  3: 

3: 

3L 

x: 

l 

0J 

C 

l  4-J 

4» 

44 

E  4- 

44 

44 

tO 

>0 

fT3 

ftl 

CD  iXJ 

ttJ 

Cji 

JZ 

_iC 

jr 

CD 

-C 

_*■* 

CO 

rx 

m  DT 

3; 

. 

<n 

a.  • 

l 

r— - 

3  o 

• 

• 

- 

< 

U— 

1  zy^r. 

1  ‘  -I 

CM 

cn 

to 

'.3 

68 

LEVEL  TURN 


U 

a* 

£ 

£ 

o 

o 


la  cu 

S  £j 

O'  >— 


LA 

LA 

LA  l/J 

00 

<u 

aj 

04  CL) 

04 

<u 

<u 

04  04 

a; 

LA 

£ 

£ 

£  £ 

£ 

4-) 

cn 

CD 

0>  CD 

a> 

o 

0> 

cu 

04  <U 

04 

cz 

X> 

XJ 

“O  TD 

X) 

<v> 

O  P^- 

o 

LT> 

4- 

4 

CO 

cO 

r— 

4- 

CO 

CM 

a;  cu 

aj  aj 

^  <+- 


cn  o 

f-H  CM 


t— 4 

CM 

ro  <3- 

oo 

0) 

X5 

XT 

C 

4-) 

o 

4J 

o 

c 

C** 

XT 

04 

■!"•• 

4-> 

CD 

<A 

cr- 

c 

f— 

04 

cl 

E 

*4— 

> 

CD 

■o 

04 

11 

<o 

03 

-C 

041 

4-> 

-C 

1  ■*"» 

00 

-C 

CD 

£ 

4- 

CD 

C 

■r— 

o 

•r-» 

•r“ 

4- 

f» * 

£ 

£ 

4— 

3 

<w 

O 

XI 

XT 

•r* 

CL 

■*-> 

jZ 

2 

«o 

-C 

u 


CT1 

c 


aj  — 


u 


xi 

£ 


o-* 

OJ 

XJ 

3 


X> 

£ 

a; 


o>  *— 


69 


c  c 

*r-  ‘T— 

£  £ 

4-»  4-> 
*4-  *-*— 

o  o 
o 

CM 


13 

o 

I 


o 

u 

Cl 

o 

X) 

04 

Q), 

cx| 

LA 


, 

4- 

O 

ir**« 

XJ 

w 

04 

4- 

o 

£ 

1  04 

E 

•6-* 

o 

>1 

■M 

5 

03 

lA 

c 

c 

LA 

C 

c 

04 

■  r- 

•r— 

X5 

04 

•r— 

3 

E 

+-» 

4-> 

04 

£ 

04 

Q£ 

04 

04 

•r— 

CA 

04 

04 

£ 

CD  C 

04 

cx 

£ 

CD 

■M 

c 

r~ 

XT 

LA 

4-J 

£ 

ro 

X 

<TJ 

cn 

£ 

X 

<Xi 

04 

-C 

LA 

♦ — 

•r— 

04 

XZ 

0J 

i/i 

u 

aJ 

xz 

A3 

04 

£» 

04 

S 

04 

x: 

04 

QJ 

04 

xz 

4-1 

_£Z 

c 

XZ 

x: 

£> 

X 

4-» 

£ 

4-> 

-£ 

04 

■*-> 

04 

3 

LA 

<D 

£  C- 

IA 

■£> 

LA 

o-* 

LA 

£ 

CM 

04  -*-J 

03 

TO 

+j 

03 

04 

03 

2  c 

* 

04 

3: 

£ 

5 

*o 

04 

x: 

04 

iz 

05 

-£>  E 
<o  cd 

+J 

to 

1  £> 

£> 

03 

£ 

CD 

4J 

A3 

+-> 

TO 

4-5 

A3 

X!  04 

_kZ 

LA 

x: 

04 

x: 

.£ 

x: 

CD 

<✓) 

3.  CA 

3 

TO 

3 

LA 

3 

3 

+-> 

04  ■ 

Li_ 

3  O 

1  o-  s: 

l  H 

CM 

on 

03 

03 

4->  - 

•■o  -oi 
*->  c 
(U  UO  o 

£  ^  <-> 
•r-  £  QJ 
H-  O  CO, 

s-  — H 


to 

d> 

4-> 

VO 

<_> 

c: 

<D 

o 

U 

Q_ 

i- 

c/0 

o 

qj 

o 

cx 

vo  0) 

s  §j 

crh- 


O  C\J 

co 


VQ 


o 

VO 


Or*.  3D  O 
co  c\j  cm  to 

r--  »"H  r— < 


OJ 

a > 

OJ 

CL) 

j; 

0J 

4) 

Q) 

a) 

VO 

uo 

•r“ 

s~ 

1m 

V- 

i. 

4-> 

4-> 

4J 

4-1 

£ 

CT> 

cn 

cn 

a> 

O 

O 

0) 

qj 

,-N 

(1) 

aj 

Cll 

qj 

tz 

c 

OJ 

<D 

+-> 

TO 

TO 

TO 

"O 

_^r. 

'4- 

<4- 

rH 

fO 

o 

VO 

r— 

vo 

o 

o 

1 

+ 

CO 

00 

CO 

VO 

CM 

o 

CM 

4- 

CM 

CM 

CM 

o 

CM 

o  o 

CM  CM 


t 


j 

\ 

? 


(TJ  CT> 

■r— 

i- 

O  -C 

o 

4J 

4-) 

"O 

v- 

c 

c  c: 

CX 

■  r~*  , 

^  TJ 

c 

^ # — *•» 

o  +-> 

o* 

oo 

cx 

cx  ~o 

■o  3  c 

4-> 

■a 

=>  4) 

O  4) 

t: 

c 

VO 

h~  o 

■ —  E 

QJ 

o 

»r— 

c: 

OJ  CD 

£ 

VJ 

J3  C-- 

~J  *r- 

E  QJ  QJ 

cr 

aj 

4->  T3 

UJ  +J 

O  J=  i/i 

OJ 

CO 

aj 

3»  c 

<J  4-> 

CO 

c  e 

Ui  o 

4-> 

O 

a> 

—J  u 

<u  qj  _e 

CD 

CO 

QJ  n 3 

oo  x  cn 

-C 

>  4~> 

O  QJ-r 

C^* 

4-> 

4~> 

4-J  4-J 

C  5  r- 

4-> 

3 

CL)  TJ 

J= 

c 

o 

-Q 

•* — *■ 

0)  4~> 

CD 

•r- 

rj 

X) 

• 

r  d  ai 

•r— 

03 

0)  QJ 

u 

+Jrx: 

X 

-a 

X.  QJ 

QJ 

rs  4-> 

a> 

0) 

0/  Cx 

V0 

4-J 

a> 

QJ 

IT  co 

C  <4- 

J3 

a. 

13 

4-J 

O 

•f“  •  o 

4-> 

to1 

4-> 

r— 

VO 

o  cx 

■t  ^ 

CO  TJ 

i— » 

a  ^  c 

4*J 

TJ  <J 

o 

4-> 

O-* 

.•o 

3: 

i 

>i  in 

CD 

TJ 

4-J 

(T3  (D  +J 

r~ 

31 

QJ  i-| 

CM 

3  .£  V- 

i — 

-- 

O 

C 

cr»  <d 

f-  u  o 

o 

*o 

•f — 

c:  > 

C 

«—  4-)  CX 

x 

fD 

CO 

TJ 

o 

ro  •<— 

aj 

QJ 

4-J 

-C  4-> 

cx 

r  av) 

£ 

c: 

E 

c 

O  :/> 

•r- 

3 

0) 

•  t — 

0) 

»“ 

oj  cr 

E£ 

. — ■■ 

X 

o 

44  4-4 

O’) 

r  a;  x 

j-j 

cx 

rC  TJ 

4->  _C_ 

x 

c 

X 

JC  Qj 

u 

+->  c 

<T3 

•  r— 

Qj 

X 

=3;  v. 

t/1 

0)  *.- 

E 

•+- 

o 

CJJ 

TJ 

x  «o 

Q) 

r~- 

QJ 

C  C  0O 

0) 

Oi 

-£C 

.  c^.  <1; 

v — - 

Q-  CT3  OJ 

.c: 

JC 

T> 

W  XJ  .c 

4)  r— 

4-J 

4-> 

3  C  4-> 

o 

-Q  4->  CD 

Qj 

vo 

O  QJ 

CO 

c  c 

V0 

VO 

X. 

TJ 

to 

>>•»“  rt3 

TJ 

TJ 

QJ 

> 

Q)  <T3 

TJ 

•—  O 

2: 

r““  -i-  5 

c: 

+->  ar 

Q) 

O  4-' 

t; 

X  CJ 

X-> 

4J 

4-i 

U 

4-J 

o  3r 

TJ 

TJ 

QJ 

X?  TJ 

O 

-C  o  -r- 

JC 

SZ 

JC 

-C 

O  c  J3 

O0  r-~  Oh 

3 

3C 

1 — ■ 

4->  X  ."3: 

tO 

QJ  ■ 

r— 

3  o 

. 

* 

. 

U- 

az 

f-H 

CM 

CO 

VO 

VO 

70 


i 

it, 


f -H  CO  CO  ^  LO  t.O  *Cj- 

m  cm  « — i  co  cm  cm 

f*l  tH 


CO 

cO 

tO  to 

Qj 

oj 

OJ  <U 

c 

03 

a; 

a>  a» 

t/1  to 

•r— 

s- 

S- 

t.  C- 

4->  4-> 

4-3 

£? 

CT> 

rn 

05  O 

O  O 

<L> 

**^ 

OJ 

OJ 

a;  oj 

c  c 

QJ 

4-> 

“O 

“O 

-a  no 

-X 

4- 

4— 

O 

o  o 

o  o 

•5f* 

o 

CM 

CO  *— * 

t"-.  r^ 

o 

o 

4- 

*— 4  (>’J 

CM  CM 

1 — 1 

a*) 

o  — * 

CM  + 


_J  •*- 
L'J  4-> 
C 

LU  O 

-5  U 


U 

03 

to 

o  i 
o 

CM 


co 


a> 

to 

o; 

o 


i-u  i 


cu 

JZ 

S- 

JZ 

c» 

05 

4.4 

'£ 

4^ 

C-. 

£ 

03 

co 

o 

c-. 

a> 

d 

S- 

4-1 

.d 

to 

O 

*4— 

Cl 

4-1 

-a 

•i — 

05 

c 

-*—> 

03 

£ 

jn 

c— 

o 

03 

rz 

tTV 

4-1 

4-1 

o 

CJ 

»r- 

CU 

■r- 

C 

a> 

•r— 

c: 

to 

2 

05 

to 

T3 

o 

£ 

Cl 

*r— 

4  j 

TJ 

CTi 

C 

..— 

sr: 

QJ 

05 

a> 

*r— 

zn 

4-> 

to 

+J 

Cl 

- 1 — 

0.J 

C 

d 

r--' 

‘f— 

<U 

4-> 

•r— 

03 

<4- 

U 

x: 

to 

*c 

S.- 

o 

!>• 

4-3 

s- 

OJ 

4-* 

01 

to 

c 

OJ 

JZ 

to 

L. 

tr 

M- 

.d 

i- 

4-* 

03 

Z3 

<D 

4-> 

■r“ 

c: 

*o 

^-3 

m  1 

jZ 

tO 

•xo  ( 

•r* 

OJ 

QJ 

-4-’ 

QJ 

Cx ' 

<u 

xz 

'xyi 

3e 

OJ 

U5I 

CL 

4— i 

a 

c: 

o 

cx 

X5 

C'. 

ro 

O* 

to  ('• 

z.* 

0- 

d 

4—' 

4-> 

r— 

o 

JZ 

*~! 

!  J~ 

“C 

•r-  1_CL- 

•r— 

03 

u 

1  C3 

c~ 

05  |  CO 

4-3 

*  J 

4-3 

4-3, 

o| 

|+J 

ffc 

•r- 

r— 

•!"• 

U 

.,-i 

S- 

\Z 

05 

44 

03 

aj 

QJ 

4-1 

....  4— 

S- 

4-> 

£E 

_d 

s/) 

43 

0)| 

t A 

•4-5 

ZJ 

4-5 

(U 

OJ  f— 

to 

>. , 

</> 

£ 

_c 

O  OJ 

OJ 

05 

<L> 

4— 

cn 

c  > 

_cr 

.JZ 

-C 

X 

O 

•«— 

OJ  <*) 

cn 

03  W 

O 

lO 

_d 

JC  — 

*r— 

•1— 

£ 

d 

U  » 

JC 

x: 

4-1 

o 

oj 

t' 

05 

OJ 

a; 

JZ 

05  03 

OJ 

05 

JZ 

JC 

4-> 

4-3 

JZ 

-C 

OJ 

4~' 

4-> 

4-1  >r-- 

4-3 

4-1 

r— 

a; 

Oi 

to 

to 

4  3 

d 

*o 

to 

03 

o 

03 

OJ 

.,— 

OJ 

03  O 

iTJ 

rt3 

«X5 

li 

jC 

^  t4 

JTZ 

4.-3 

4-'  JJL 

4~> 

4—1 

o 

<o 

a; 

<n 

03  C 

o; 

03 

4-1 

_ir 

.d 

JZ 

.C  03 

JZ 

•r— 

^Tii 

i?. 

4-3 

'X 

zz 

li' 

zs. 

Q. 

CM 

C"> 

LO 

to 

71 

\ 


y 

i.  1 


L  . tw^lA  \A  bliL  4—^. 


i-  tn 
03  -TD 

+r>  c: 

OJ  OO  o 

e  u 

•r*  E  O) 
I —  O  00 


lO 


m 
o  c 
cd  o 
s-  ci 

5-  to 

O  CD 

o  cc 


cn  oj 

s  §j 

O'  h— 


2:  — • 
CH  XJ 
CD 

h~  3 

c: 

LlJ  +j 

:>■  cr 


o 

c;-. 


CO 

CM 


i-h  i —  lD  O 
l^fv  u?  CT^ 


-C 

OJ 

x: 

<D  U 

4-> 

x:  -m 

4->  *t- 

4- 

Q. 

O 

4-> 

C  -5-> 

CO 

CD  'D 

“O 

E  oj 

c 

CD-C 

0 

<D  CD 

u 

</)  — 

QJ 

xz 

C^- 

l/J 

4-> 

4~> 

XZ  OJ 

c 

LO 

CD-C 

CD 

CM 

*r —  4-> 

E 

r— 

cn 

4-> 

4—  </> 

<D 

t/> 

«/> 

03 

CD  5 

< - 

x= 

4-> 

4—'  4-> 

-C 

CD 

ro  uj» 


*\i 

CO 


XI 

c 

tTJ 


cn^c  »— 

3  <+- 

o 

S-  •  <D 

J= 


>,  a;  <+- 

03  -»-  o 

3:  j- 

X3  C 

a)  o 

XT  CL-r- 
+J  3 


aj 

cn 

c 

03 


a) 

s- 


XJ 


to 

un 


V> 

CD 

cn  in 

cn  lo 

QJ 

QJ  QJ 

QJ  QJ 

U 

CD  QJ 

cd  a; 

in 

CD 

i-  i- 

s-  s- 

4-> 

QJ 

CD  CD 

CD  CD 

O 

XJ 

CD  QJ 

OJ  QJ 

c. 

X)  X> 

*0  XJ 

-X 

CO 

+ 

03  un 

m  0 

CM 

CO  1— 

0  t~» 

CD 

1  + 

ro  ro 

CM 

T3 

CD 

CD 

9* 

C/J 

i. 


e 

3 


o; 


cn  x>  O 

X 

03 

X 

13  qj  a 

aj 

<D 

C-* 

f0 

u  xz 

•r—  CJ  (/I 

CD 

X 

4-> 

c 

E 

x:  4-j  •*- 

.c 

QJ 

OJ 

a.' 

+->••-  x: 

4J 

XT 

E 

x: 

1  CL 

O 

QJ 

4-i 

CD 

a; 

4^ 

2  a,'  C 

S- 

C/1 

cn 

cn 

4*-^  C 

QJ 

03 

03 

r-  <U| 

2 

2  4-» 
X 

2 

3  0_f— *  1 

4-J 

4-> 

CD 

4-5 

0  i-  cH 

03 

/a 

•f* 

Qi 

X)  *r-  C 

x= 

X 

r— - 

JZ 

<  «o  <o| 

3 

3: 

4- 

3. 

CM 

CO 

•^r 

r-H  CM  00 

un  cm 


4->  E  E 
<D 

CD  -M  •*-» 


000 
o  00  o 

nto  ^ 


O' —  Cvl 
CM  l  + 


C 

CD 

£ 

CD 

QJ 

IO 


C— 

XJ 

CD 

<D 

CM 

CD 


+-» 

i- 

QJ 

> 


•a  1 


OJ 

E 

QJ 

S- 


X 

<D 


Q) 

X 


cu 

x: 


cn 

m 

I 


QJ 

L. 

a» 

3: 


4-» 

03 

xz 

3: 


72 


iittMtMftiaiiaNtt 


DESCENT 


f 


t 

| 


X  \A 

<VS  TJ 

+-»  c 

<d  uy  o 

E  O) 
*-•>  O  c**} 
V. 

u_ 


CM 

CM  CO 


r-4  ny 
CM  CO 


o 

CM 


lo  co  o  t*-*  o 

o  CM  O  CM 

t — i  r—1  r-»  t»i 


I 


1 

I 

i 


1 

to 

t/f  to 
<U  03 

CO  CO 

03  Q3 

to 

03 

l/> 

or 

0)  03 

<U  03 

03 

4-> 

(Ol 

J-  S~ 

l.  r- 

s- 

4-3 

c 

Cj 

a>  cn 

CO  T 

0 

03 

O 

Cvl  c* 

o>  cu 

03 

c 

S- 

V- 

§ 

-a  -0 

-o  •O 

"O 

JX 

O 

CJ 

LO  «V 

0  0 

CM 

to 

O 

cx 

4  ! 

r— 4 

0 

t— H 

m 

n  c 


44  4^ 

E  £ 

03  03 

03  03 

4-3  4J 

tv  V- 

<4-  0- 

t-4  C*  > 

O  O 

0  LO 

O 

O  CM 

LO 

0,  r- 

•• 

0  1 0 

rO 

CM 

1 

> 

\ 

i 

I 

t 

l 


j 

j 

i 

r 

i 

! 


i/l  CL> 

qj  a 


U1 

a> 

</i 

o 

OJ 


r> 

(X 


a» 

(/> 

03 

O 


n 

co 

T3 

c 

03 


x: 

03 


<*.. 

<13 

sz 

4-> 

oi 

cr. 

t. 

o 

TJ 

03 

a 

w 

<o 


a 

H- 

o 


l/l 

a1 

e 

OJ 

u 

+-» 

X 

CJJ 


o> 

i-  <•*• 

O  4-J 

3;  c: 
cu 

4>  £ 

-T3  CT> 

x:  cu 
3:  1/1 


<u 

> 

ai 


o 

l 


£ 

03 

O 

> 

w 

03 

Cv* 

r— 

c: 

r: 

0 

t>~ 

0 

•r— 

O 

4-> 

4.4 

tO 

4-> 

(J 

S»- 

to 

•r» 

ro 

c 

X3 

4-3 

rrl 

c 

t/) 

V- 

4-> 

CU 

a1 

X= 

03 

.El 

4-> 

■X 

4-1 

T3 

03 

<T3 

S- 

f; 

03 

O 

•t** 

x: 

0- 

a> 

*0 

T3 

SD 

03 

<13 

x 

*- 

4.’ 

s- 

0? 

LO 

13 

XI 

13 

u 

K 

**“> 

O' 

3 

0 

C- 

X3 

03 

r-- 

4.’ 

0) 

k~ 

t/> 

Cl 

oUj 

03 

Ul 

M  = 

J 

w 

C3 

O 

-r— 

C  U 

f—“ 

ttJ 

•»—  t/1 

ijJ 

OJ 

1  03 

<U  ATi 

-C 

X* 

CO 

44 

1  -V-* 

c.  0 

OJ  t-3 

t/1  t/1 

XT 

ro 

tj 

3 

:  X 

-LT 

4-j  ai 

4- 

>  4-) 

0:  •»— 

«c 

! 

SI  i»- 

X 

:  x* 

JC  V-  - 

3-  3 

c 

g 

O 

0> 

t/> 

a; 

sz 


<IJ  I 

x> 


o 

B 

cu 

x 

4-> 

X 

a> 

03 

-C 

+■» 

O) 

V, 

c. 

j£ 

4-3 

OS 

.c 

3K 


C 

o 


s» 

c= 

03 

s- 


CJ 


~n 

03 

& 

to  I 


o? ! 

o 


u  o» 
01  h— 

>  |*4— 

o 

Cl  I 

a; 

o;  > 

o  >  03 

c:  »— 

03 

sz  o 

o  4-3 

aj  4-3 

x:  c 

4— 1  03 
CJ 
to  to 
fCJ  03 

2  *o 

4-‘  HE 
«3  O 
_t“  X 
“K  <*- 


to  * 
0>  • 
n  ol 

O’^l 


r\ 


i-  tO 
r  O  T3 
c 


d  Ln  o 

o  ^r 

LO 

CM 

co  cn 

rH  O'* 

CO 

£  c> 

CM  CM 

1—4 

CM 

CM  tO 

CM  CM 

CM 

•r-  £  O) 
h  O  OO 

< — 4 

S-  - — ' 
U- 

t/1 

<D| 

V'  to 

to 

to 

<1)  CD 

<D 

CD 

c 

1  4->  001 

|  (_)  c 

(D  01 

CD 

CD 

to  VI 

■F- 

S.  J_ 

L. 

5- 

4-J  4-> 

4-J  4-> 

E 

a;  o 

i_  a. 

cn  cn 

cn 

cn 

O  O 

CD  01 

sv 

<D  01 

D 

0i 

G  G 

CD  <D 

4J 

i-  to 

-a  -o 

T3 

T5 

V-  4- 

4- 

O  CD 
O  CK 

O  O'* 

O 

O 

CO 

o  o 

O 

+ 

tn 

co  cn 

o  cn 

O 

o 

cm  cn 

O  *-H 

cn 

O  O  on 
CM  CM  + 


l 

[ 


s 


Vi  CD 

cd  a_ 

^ — ** 

v 

V 

CM 

cn 

, — i 

CM 

cn 

cr  1— 

N“' ' 

s — 

- — ' 

- - 

C-- 

c»- 

4-> 

4-J 

C“ 

<r 

!  a* 

0) 

D 

i  JC 

S- 

U 

O 

I  ■*“> 

O 

v> 

to 

4- 

O) 

D 

0-« 

T3 

"O 

4-> 

4->  4-J 

1  -c: 

•i-  C 

CD 

CD 

"O 

:  cn 

CD 

-C 

x: 

i—  a> 

•r— 

cnc^  u 

4-5 

4-J 

•M 

IT  =3 

r— 

c:  cd  to 

C 

LiJ  C 

4- 

—  cn  o 

4- 

<D 

O 

<_>  •<- 

S-  C  T3 

O 

E 

4J 

cn  +j 

r— 

CD 

O) 

LU  C 

D 

3=  -C  CD 

4-5 

01 

i- 

Q  O 

> 

O  <-l  -C 

L. 

to 

O 

CV. 

u 

a» 

[ -  4~> 

T3 

•1“ 

"Cl 

-C 

4-3 

<D 

J- 

t- 

o  u  c 

to 

-C 

CL 

ro 

c 

4-1  4-1  *r- 

4-» 

3 

•i- 

•r— 

Ol 

4-» 

CL 

S-  CL  4-> 

-C 

c 

to 

3 

> — *• 

O 

O  4~ 

4-5 

♦— 

3 

•1 

r— 

•r-  r—  CD 

•O 

■ol 

CJ  ; 

cn 

&-  03  r— 

o 

-o 

D 

0)1 

c 

CL  — 

4-J 

<D 

D 

D 

to . 

no 

4— >  Qj 

CD 

“O 

CL 

-  —  -C 

i- 

CL 

3 

to 

LD 

-C 

a  c  4J 

o 

to 

W 

T— H  I 

u 

3  ■— 

■— 

i- 

•r— 

r— 

•  < 

4-> 

o 

s_ 

•p— 

4-1 

•p— 

C  to  4-> 

CL 

cu 

r— 

u 

1 

CL 

CD 

fO 

•  /— 

sz  x:  — 

4-J 

4— 

4J 

CM 

f— 

4->  4J  r— 

to 

O 

cr 

V- 

03 

O 

3 

-f— 

D 

C 

*>— 

♦  to 

**n 

LO 

> 

u 

4-J 

cr 

<D 

D 

C£ 

•i— 

?  J  E 

cn 

E 

to 

4-5 

c 

O  3 

cr 

D 

m3 

V) 

•* 

-r— 

■Q  ■*-*  E 

••— 

L- 

D 

D 

rO  — 

T3 

4-J 

W- 

-rr 

c 

4-j  x:  x 

0.1 

X 

o 

03 

01 

fa 

x:  3  <T3 

O) 

D 

c 

t0 

cn  e 

jr 

*P“ 

-C 

«TJ| 

E 

3 

D 

<-J 

o 

O  •  CD 

OI 

-C 

D 

D  • 

—  -— 

u 

C  4J  -C 

-C 

4-J 

sz 

-C 

4-  X>  C  4J 

4-> 

4-J 

4-J 

•«^r 

o> 

D 

cn 

cn 

l/»  u  s> 

to 

t- 

to 

to 

CJ 

03  iT3 

no 

D 

no 

■a 

-f— 

X  <D  3 

3 

3 

3 

3 

c 

4—1 

T3 

CD  4-3 

4-J 

4-J 

4J 

4-1 

<TJ 

tn  0l  03 

fO 

no 

no 

03 

4—1 

O  J3  _C 

-C 

_C 

-C 

x: 

r”1 

m 

c  4->  3 

3 

3 

3 

3 

, 

to 

4J 

<D  • 

i— 

3  O 

• 

. 

• 

• 

• 

U_ 

o-  z: 

rH 

CM 

cn 

LO 

to 

74 


DESCENT 

(continued) 


i 


MQMft’rfcr 


DESCENDING  TURN 


S-  in 
rO  "O 
■M  C 
Q)  0/)  O 
E  u 
■r-  £  OJ 
H 

i- 


K/i  on 

00  </> 

on 

on 

OJ  QJ 

<D  OJ 

Oj 

C;  C 

OJ 

QJ  QJ 

QJ  QJ 

OJ 

on 

r  r— 

4J 

(/■J 

S- 

S-  i- 

L. 

4-> 

4->  4-> 

E  E 

O 

c 

cr>  cn 

cr>  cn 

cn 

O 

qj  a: 

<u 

o 

QJ  OJ 

qj  a; 

cu 

c 

QJ  OJ 

4->  4-J 

i- 

c. 

-o  "a 

~XJ  TJ 

X3 

4-  <4- 

<4-  4- 

s- 

Ln 

o 

QJ 

*3- 

o  o> 

O 

OJ  co 

o  o 

o 

cn 

4-  1 

v\J 

o 

o 

o  ir> 

t 

o 

ro 

O  <r> 

un 

QJ 

•r— 

a; 

O  +-> 

XI 

OJ  c 

<u 

OJ 

x 

X 

4.J 

X  *f- 

x 

-XT 

4-» 

QJ  CT> 

4-> 

4-> 

4-> 

cn-r- 

OJ 

OJ 

a; 

C  r— 

i~ 

y>  XT 

</>  o- 

on 

u 

03  4— 

QJ 

fD  4-> 

fO  4-> 

ra 

QJ 

X 

3; 

3 

X  c 

5 

? 

OJ  OJ 

l- 

QJ 

X 

4-> 

4->  QJ 

4->  O 

4-1 

4-> 

4_1  4-J 

ra 

03  ■*-> 

<tj  on 

03 

ftJ 

QJ 

X 

X  4- 

x-  a> 

XT 

X 

X  4- 

2 

3;  <o 

3  "O 

* — ' 

3 

3  O 

1— 

OsJ 

m 

uO 

77 


I 


S-  O) 
*T3  -O 
4->  C 

<u  on  o 
E  o 

•r-  E  d) 

^  o  to 

s_  > — 


lO  to 

to 

to 

a)  0) 

CU 

a> 

OJ  01 

a» 

OJ 

S-  s_ 

i- 

L. 

cr>  a> 

cn 

C7> 

<u  oj 

<V 

<D 

X3  TJ 

T3 

X3 

co  co 

O 

O 

1  + 

C\J 

in 

C\J 

O  O  ai  <L) 

C  C  ai  <u 

J*  «+-  <4_ 

0^0  OQ 
*d*  r—  O  CO 
CMfO  OCM 


co  o 

E 

r*— 

C  1 

•r“ 

<T3  . — 

X 

C 

.c  a> 

03 

CJ  > 

£ 

4- 

<L> 

0)  »— • 

OJ 

<U 

-C 

o 

■*-» 

4J 

</> 

tO 

to 

4-> 

03 

03 

X  c 

Q) 

■M  U 

? 

2t 

4-J 

40 

03  to 

03 

03 

sz  a» 

-C 

-C 

_X  T3 

. 

r  -1 

CM 

CO 

78 


DESCENDING  TURN 
(continued) 


■l->  - — * 
W  in 
45  T3 

4- >  C 
<U  LO  0 

E  u 
—  E  cd 

r—  O  <S) 

5-  ' 


cn 

ro 


UT)  O 

»-H  CvJ 


CO  o 
CO  C\J 


; 

tO 

cn 

cn  cn 

i 

cn 

CD 

OJ 

CD  CD 

c 

aj 

a; 

<D 

CD  CD 

cn  m 

i 

4-J 

CO 

s. 

S-  i- 

4-J  4_) 

4-J 

E 

i 

U 

c 

cn 

a> 

cn  cn 

O  O 

a) 

CD 

o 

<D 

QJ 

CD  <D 

c  c 

<D 

M 

1 

S- 

CL 

-a 

TD 

T3  T3 

j*  .^4 

<4- 

4- 

s- 

o 

on 

<D 

<£> 

On 

O  O 

cn  o 

O 

i 

o 

OL 

i 

C\J 

f^v  lD 

co 

O 

O 

■i 

4- 

*-H  C\J 

CO  CO 

CXi 

co 

! 

r> 

* 

t 

uo 

CO 

in  CD 

2J  §j 

cr  J— 


cn 

T-M 


cn 

co 


u 

<u 

CO 


O 

CVJ 


I 

CO 

c 

cn 


CT> 

CD 

cn 

<0 

O 


a> 

co 


“O 

c 

05 


co 

<D  • 
3  O 

az: 


*-> 

x: 

cn 


QJ 


a) 

4-J 

<D 

-C 

JZ 

-C 

4-J 

cn  -4-J 

•r* 

c 

s- 

4— 

•r- 

<JJ 

o 

<D 

_c 

c 

r— 

4-J 

o 

on 

•  1 — 

c 

o 

4-J 

*13 

4-J 

<TJ 

■  r— 

XI 

i — 

|4J 

u 

f— 

4-J 

o 

1  57 

•f— 

1  s- 

!*■“ 

0-1 

E 

S- 

4-J 

3 

<D 

cn 

E 

4-J 

(D 

•f — 

4— 

5 

X 

<0 

o 

03 

*— 

E 

cn 

40 

CD 

qj 

C 

x: 

-C 

O 

4-J 

+-> 

u 

CD 

cn 

<n 

c/> 

*tJ 

03 

X 

3: 

4-J 

4— > 

4-J 

cr 

03 

03 

a> 

-C 

X= 

s 

3: 

4-J 

o.. 

cn 

c 

o 


o 

4.J 


0) 

3 


T3 

i- 


03 


■O 

c 


j? 

“O 

*o 

CD 


(O 

> 

ra 

a; 

CL 


E 

o 


c 

aj 


cn 

CD 


lO 


aj 

-c 


“O 

OJ 

a; 

Q4 

on 


cn 

“O 

L_ 

OJ 

CD 

•  r- 

r~ 

X 

a; 

ra 

O 

CL 

QJ 

CJ 

i— • 

cn 

“O 

■  r— 

S- 

3 

4-J 

T3 

■i — 

4-> 

i- 

C 

03 

■  r— 

QJ 

03 

4-» 

> 

C 

r— 

4-J 

*  r  - 

03 

4— J 

in 

in 

QJ 

CD 

4-> 

QJ 

-C 

cn 

cn 

4-> 

cn 

c 

CD 

ro 

43 

o— 

QJ 

JO 

-C 

aj 

O 

U 

o-* 

aj 

u 

o 

r— 

Oi  W 

r— 

c 

-C 

a; 

43 

QJ 

CD 

CD 

4-> 

-C 

> 

JC 

SZ 

C 

4-> 

4— J 

4-> 

cn 

OJ 

r — 

CD 

t. 

cn 

*U 

cn 

in 

cn 

<D 

«3 

c 

ro 

03 

3 

r— 

CD 

4- 

-C 

4— J 

4-> 

4) 

4-J 

4-J 

<0 

43 

cn 

03 

ra 

-C 

-C 

♦j 

-C 

_C 

4~ 

O 

ro 

xr 

cn 

<X> 

;  79 


<x>  <y>  o 
E  _  o 
—  e  oi 
I—  O  00 
s-  - — • 


«/> 

cn  cn 

cn  cn 

QJ 

a;  a> 

a>  aj 

c  c 

OJ 

a;  a> 

CJ  CD 

cn 

•I —  *f— 

L. 

s-  i- 

JL.  S- 

-4-> 

4-> 

E  E 

cn 

cn  cn 

cn  cn 

O 

<1> 

<D 

cu  <D 

CD  CD 

c 

aj 

4~J  4-> 

X) 

T3  XJ 

xj  -a 

4- 

4-  4- 

C\J  f— t 

o  o 

LO 

C\J 

O  O 

l 

CO  f— i 

CM  CM 

CM 

O 

o 

1  + 

T—i  1 - 1 

CO 

O 

co  oo 

* 

•*  4- 

o 

LT> 

1/1  01 

0)0.  - — ■ 

3  5h  "3- 
0-1— 


r~— 

<D 

1 

UL 

E 

m 

<D 

CD 

J= 

xr 

aj 

0) 

XZ 

x: 

-4-J 

O)  cn 

-C 

x: 

4-> 

4J 

CD 

cn-r- 
c  « — 

4-> 

+-> 

<D 

cn 

(T3  l*- 

m 

in 

fO 

<d 

.C 

co 

co 

<D 

3 

3 

u  a; 

3 

3 

3 

-C 

+-> 

4-> 

-*-J  4-> 

4-> 

+-> 

-*-> 

n3 

CO 

ft* 

CO 

CO 

n3 

x= 

SZ 

-C  4- 

x: 

SZ 

-z 

“? 

^  o 

3 

Z3 

, 

CM 

CO 

lT) 

CO 

BO 


APPENDIX  D:  STRIP  CHART  RECORDINGS  OF  THE 
SIX  FLIGHT  PARAMETERS 


PITCH  ROLL  HEACiNG  AIRSPt.  )  MMTUDZ  ZERO  TIME  VVI  " 

(dcarens)  (degrees)  (de~r?es)  (knots}  (feet)  (seconds)  (ft/min.) 


H,nb  -  Run 


<8 

a 


ci  t 


o 

UTi 

CM 


{- 


>  £ 


V9 

ux  c 
ac  o 
—  u 

*—  0) 
v) 


<rv 


c 

a: 


i 


u 


.cf  P1 


fV  f 


o 

,r. 


41  '**•• 
..  >  ■*'■ 


CO  t 

oc 


v/i 

CM 


o 

I/O 

Osl 


Ci  *7 
3£  OJ 
1* 

o  u. 

«:  c/» 

Ui  oj 


i 

I 


i 

I 


c 


o 

vn 


<✓» 

~J  o 
_i  <t» 
O  5- 
oc  cn 


vri 

CM 


I 


84 


lT> 

CM 


Run 


Climbing  Turn  -  Run 


I - 1 Uaktea&Zi&S&Mu i&>b  --'■•■  - ■.  ^ 


o 

141 


o 

LD 

OJ 


o 

lO 

CO 

+ 


O  </i 

2:  CJ 


<c. 


o» 

5- 

CT> 


IjU  QJ 

:e  *0 


V 


o 

U1) 


o 

m 

+ 


00 


<St 

OJ 

-J  o 

^  V. 
O  CT» 
cn  ai 
X3 


89 


•.n 

CXI 


a» 

*•«  0; 

a.  T7 


degrees)  (degrees)  (degrees)  (knots)  (feet)  (seconds)  (ft/min.) 


Level  Turn  -  Run 


Level  Turn 


PITCH  ROLL  HEAOING  AIRSPEED 

(degrees)  (degrees)  (degrees)  (knots) 


Level  Turn  -  Run 


UlUl, 


o 

in 

CM 


o 

uO 

+ 


^  r  *-s 


LTJ 

CM 

I 


94 


LT> 

CM 

■+- 


PITCH  ROLL  KEAGING  AIRSPEED  ALTITUDE  ZERO  TIME  VVI 

(degrees)  (degrees)  (degrees)  (knots)  (feet)  (seconds)  (ft/min.) 


95 


o 

Lf) 

CVI 


O  v* 
Z  OJ 
»— <  dJ 

o  s_ 

<  CD 
UJ  <D 

IE  *o 


<y> 

CD 


O  CD 

a:  a; 
■a 


LD 

oj 

z  aj 
CJ  i- 
h-  CD 

— *  aj 
a-  “o 


♦.Vi 


i  f-  "* 

O 

to 

CNJ 


C\ 


*W  JsSWwA  ->*> 


^re<s)  (degrees)  (degrees)  <*nots)  cK5,  (spends)  (ft^ln.) 


Descending  Turn 


Descending  Turn  -  Run 


PITCH  ROLL  HEADING  AIRSPEED  ALTITUDE  ZERO  TIME  VVI 

(degrees)  (degrees)  (degrees)  (knots)  (feet)  (seconds)  (ft/min. 


SUB-SESSION 

1 


2 


Fit. 

Seq. 


FI iqht  Parameters 


pilot!  no. 


i 


«  2  6  5 

5  o  u  3 

2  ~  1  l  <1 

5  6  U  1 

1  fc  2 

5  -  -  t - j 

__  to  2  3 

2  3  5  6 

3  5  12 

2  fa  5  n 


2  3 

1  6 

3  1 

1  2 

3  « 

“  _  1 
U  3 

«  -  3 

b  2 

b  5 


SUB-SESSION 

1 


2 


i ,, 

'  Seq. 

SUB-SESSION 

1 

Fliqht  Parameters 

PIL 

i  ■« 

a-  - 

3 

3 

}  11 

6 

b  2 

5  1 

“l 

2 

a 

22 

\  5 

b  1 

2 

H 

3 

;  2 

< 

!  5 

a  2 

£> 

1 

3 

i  16“ 

■  *i 

3  5 

1 

6 

2 

;  30 

;  ’  -  '  ~  b 

n  S 

l 

2 

3 

!  JP- 

SU8- SESSION 

1 


PILOT  ;  0,  6 


2 


Il 


SUB-SESSION 

1 

Flight  Parameters 


MO.  3 

2 

32 

3 

“S' 

~b  ~  r 

2 

1  4 

3 

l 

6  2 

5 

,  | 

2 

2 

4 

3  to 

1 

C 

15 

** - - 

“V  - 

“  "b 

2  « 

1  “ 

J 

9 

~  30 - 

5 

1 

4  3 

to 

t 

3 

5 

e>  l 

2 

i 

26 

“5  - 

“1 

3  "a 

2 

.  , 
t 

lb 

-■16 - 

2 

t 

1  a 

5 

- 

1 

3 

0 

5 

i 

6 

3 

2 

■  "  4  b 

'  S 

! 

«  3  5 

a-  -a  -  -  3 


i 


PILO 


SUB^SESSION 

Fit. 

$eq.  Flight  Parameters 

u 

*  1  2  6  S  5 

29 - * - -  -  - 

1  «  b  b  2  3 

25 

6 - n  -  j-  ,  -  s  —  2  - 

b 

_ _ «  £ _ __  J  0 

«  1  3  b  5  2 

40 

H  b  ~5  -  2 - 3  ~  ‘I  - 

3b 

_ 1 _ 3 _ 5  _  «,  __  2_ _  b 

b  5  2  3  b  i 

19 

3"  2  5  4  ■  1  b 

n 

2  3  «  5  1  b 


3 


SUB-SESSION 

1 


PILOT 


\m 


117 


I 


f 


4 

a 


i 


A 


APPENDIX  F 


Pilot  # 


Date _ 

Name _ 

Total  Flight  Hol^s 

Present  Equipment^ 
Hours 

In  Other  Equipment 
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i.  INTKUUUd  I  J.Uf'J 


Tnp  purpose  of  tnis  initial  stouy  was  to  uevelop  anp  implement  a 
recommenpeo  metnod  of  evaluating  alternative  airplay  formats  for  use  in 
trie  instructor/operator  station  of  a  fliynt  simulator.  Tne  woi'k  incluueu 
conouctiny  a  orief  literature  survey,  analyzing  tne  instructor ’ a  joo,  anu 
ppvelopiny  a  yoou  upproacn  to  uisplay  evaluation,  uur  approacn  centered 
around  dpvelopiny  a  pencnmarK  taSK  tnat  exercises  many  of  tne  skills  oseu 
py  an  instructor;  uevelopiny  ways  tu  measure  a  suoject's  performance  of 
tnat  tasi<;  ana  usiny  tne  aeriveu  measurement  metnou  experimentally  tu 
infnr  tne  effectiveness  of  a  given  display  format. 

Tne  following  sections  document  tnis  worx  anu  present  conclusions  anu 
recommendations.  Important  refinements  of  tne  metnou  were  tnen 
performed,  anp  a  more  coinprenensive  te-t  anu  demonstration  of  tne  metnou 
was  conoocteo  as  a  seconu  study  anu  is  oocuinenteu  in  tne  main  uuoy  of  tne 
report. 

li.  LiTtKAruKt  ScAKud 

we  oeyan  witn  a  literature  survey  tu  uetermine  tne  current 
capaoiiities  and  Knowieuye  reyaroiny  nian--macnine  system  performance  in 
training  systems.  In  particular,  we  selecteu  anu  revieweu  x  uocuments 
pertaining  to  Human-monitor ino  neiiaviur,  performance 

measurement /evaluation  tecnniques,  uKF  display  systems  anu  numan  factors 
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tecnnology.  Tnese  are  listed  in  Appendix  H.  Inis  first  review  was 
primarily  focused  on  tne  austracts  ana,  wnere  appropriate,  summaries.  in 
general,  most  reports  reviewed  dealt  witn  analysis,  evaluation,  uesiyn, 
and  development  of  flignt  simulator  systems  ana  suosystems.  Typically, 
empnasis  focused  on  wiue  angle  visual  systems,  cumplex  motion  piatfurms, 
sopnisticateu  CRT  cocKpit  displays  ana  crew  interfaces,  nesearcn 
relative  to  tne  functions  anu  interfaces  fur  tne  instructor  was  virtually 
nonexistent,  (it  would  appear  tnat  tne  oesiyn  uf  tne  instructor  con^olCa 
nas  oeen  dictateu  oy  simulator  oesiyn  rdtner  tnan  uy  instructor  functions 
ano  information  requirements.) 

uf  tne  i>u  aostracts  revieweu,  z<_>  appeareu  to  contain  information 
applicaole  to  tnis  researcn.  we  jroereo  complete  uocuinentatiun  for  tnese 
works  ano  reviewed  tnem  in  more  uetail.  Tnese  ko  reports  are  inuicateu 
by  asterisks  in  Appenuix  H. 

Tne  second  level  uf  examination  focuseu  on  identification  or  tnuse 
documents  witn  specific  application  to  tnis  proyram.  Tnrouyn  tnis 
examination,  we  identified  l1  documents  Unuieateu  oy  uouole  asterisks  in 
Aopenuix  n)  tnat  were  useful  to  tne  urogram  dnu  anaiyseu  tnem  in  greater 
detail,  inis  analysis  iuentifieu  tne  tecnnulogy  cateyury  of 
applicauility  tmanAiidcnine  systems,  task/workloau,  display  systems, 
performance  measurement,  anu  performance  evaluation;,  pruouceu  austracts 
Qf  stuay  scope,  dnu  suminarizeu  primary  stuoy  tecnnipues  useu,  salient 
input'oulput  parameters,  specidl  capaoilities  anu  limi tati- >nd  jnu  areas 


of  program  applicaoility .  Tne  results  of  tnis  review  are  summarized  in 
Appenaix  1. 

In  general,  altnougn  aata  were  availaule  wnicri  applieu  to  many  issues 
requiring  consideration  in  tne  conuuet  of  tnis  stuuy  tsucn  as  tasK 
analysis,  man/macnine  tasK  allocation,  advanced  uisplay  tecnnology,  and 
operator  performance  evaluation),  no  uata  were  availaule  relative  to  tne 
development  of  inetnoaologies  tnat  could  ue  useu  to  quantitatively  compare 
tne  relative  merits  or  deficiencies  of  one  display  system  witn  anotner. 
However,  tne  literature  review  uio  prove  useful  in  esteulisning  an 
understanding  of  tne  potential  tecnnical  proQlems  anu  in  reinforcing  our 
knowledge  tnat  tnis  effort  would  oe  exploratory  in  nature. 


Hi.  INSTHuCTUK  PiLUl  JUri  AnAlYpH 


To  determine  canoiuate  maneuvers  trist  couio  ue  useu  in  uencnmai tasx. 
aporoacn  to  tne  evaluation  of  iui>  displays,  we  conuucteo  a  urief  analysis 
of  tne  rule  ana  duties  of  the  simulator  iP.  Inis  analysis  auuresseu  tl) 
IP  duties,  i,z)  iP  tasKs  anu  skills,  ana  to)  iP  information  requirements. 
Analysis  metnodoloyy  as-  well  as  results  are  discussed  in  tne  following 
paragraphs. 


IP  Duty  Analysis 
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We  identified  tne  overall  duties  of  a  typical  remotely  located  iP, 
monitoring  ana  controlliny  stuoent  performance  in  a  simulator,  anu 
categorized  tnem  as  follows:  simulator  set-up,  proolem  set-up, 
system/stuaent  performance  monitoriny  ana  assessment,  cummunicate/monitur 
programs,  on-line/off-line  aeoriefiny,  ana  altering  or  auaptiny  tne 
training  proolem  dependiny  on  tne  stuoent  pilot's  performance.  Tne 
r^lationsnip  of  tne  aforementioned  IP  duties  are  illustrated  in  Fiyure 
G-l. 


As  tne  operator  of  trie  simulator  (.set  up  simulator j,  tne  iP  is 
expected  to  cnecK  tne  system  to  insure  tnat  it  is  reauy  fur  tne  training 
session  to  oe  unaertdKen  at  tnat  time.  inis  may  involve  tne  removal  of 
some  conditions  left  over  from  a  previous  fliynt,  coordinating  witn  tne 
software  control  operator,  as  well  as  testiny  anu  valiuatiny  operauiLity 
of  tne  systems  and  its  components. 


in  setting  up  tne  proulem  tne  IP  must  prepare  inputs  required  to 
properly  initiate  tne  system  as  well  as  convey  to  tne  trainee  wnat  is 
exppcted  of  nim.  Tne  amount  of  interaction  oetween  tne  iP  anu  trainee^) 
urpenos  on  tnG  Qualification  driu  GApGrionuG  of  tnG  irdinGG  t.Mv'  level 
of  difficulty  of  tne  tasK  to  oe  trainee.  Tnus,  even  tnuuyn  tne  overall 
duty  of  tne  IP  remains  tne  same,  tne  amount  of  time  anu  tne  level  of 
detail  of  interaction  can  vary  siynificantly . 


Monitoring  of  simulator  functioning  snoulu  ue  performed  oy  tne  system 
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operator;  however,  tne  IP  is  quite  often  requireu  to  perform  tnis> 
function  merely  oecause  nis  activity  overlaps  witn  that  of  tne  operator. 
Also,  for  reasons  of  continuity  or  to  minimize  oelay,  tne  IP  will  in  many 
instances,  automatically  monitor  tne  system  functions  even  tnouyn  ne  is 
not  required  to  oo  so.  Inougn  tnis  activity  aoes  not  usually  require 
excessive  IP  time  or  attention,  it  coulu  oe  a  significant  consiueration 
during  neavy  tasx  loaoiny  anu  multi-coCKpit  monitoriny  situations. 

The  taSK  of  monitoring  student  or  trainee  performance  uemanus  tne 
primary  attention  of  tne  IP.  he  is  ootn  tne  certifier  anu 
aiagnostician.  instructor  efficiency  oepenos  on  tne  capauiiity  to  oeteot 
indications  of  stuoent  performance.  Sucn  inoicatiuns  are  tne  logical 
Oasis  for  nis  assessment  of  stuoent  performance  of  tne  trainee,  ano  tne 
IP's  duty  will  vary.  In  retraining,  tne  instructor  wiii  oe  required  to 
alter  tne  problem,  communicate  witn  tne  trainee  anu/or  support  personnel 
and  Determine  ton  effectiveness  of  tne  remedial  measures  taxen.  if  tne 
trainee's  performance  is  satisfactory,  tnen  tne  tasx  of  tne  iP  is  greatly 
simplified;  ne  merely  monitors  tne  student's  performance  tu  verify  tout 
it  continues  to  oe  satisfactory  anu  prescriops  new  material  or  nigner 
levels  of  difficulty. 


IPTasKS  and  Sxills 


Por  tne  purposes  of  tnis  stuuy,  we  uevelopeo  an  operdtiunjL  bcenur iu 
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upon  wnicn  tne  IP's  task  anu  skill  analysis  was  performed.  The 
operational  mission  selecteu  representeu  a  typical  air-tu-yruunu  mission 
emphasizing  tne  terminal  penetration  ano  attaCK  phase.  we  selected  tnis 
phase  since  it  involved  a  variety  of  activities  u n  tne  context  of 
monitoring  student t system  performance)  that  require  tne  IP  to  utilize 
various  processes,  skills,  ano  content  of  information  presenteu. 

Tne  functions  of  tne  terminal  navigation  ano  attaCK  phase  incluue  v.a ) 
monitor  simulator  performance,  to)  navigate,  (c)  search  for  ano  acqoire 
target,  (u)  prepare  for  attack,  ana  (,e)  deliver  weapon,  witnin  eacn 
function,  we  identified  tasks  that  neeueu  to  oe  performed  uy  tne  stuuent 
pilot.  w«  tnen  examined  eacn  of  tne  pilot's  tabus,  from  tne  viewpoint  ot 
the  ip  as  a  monitor  ana  evaluator  of  tne  stuoent  pilot's  performance  of 
that  task,  with  tne  exception  of  monitoring  tne  simulator  function,  tne 
tasks  for  tne  student  were  founu  to  oe  quite  different  from  uiuae  of  tne 
IP  in  that  tne  former  primarily  involve  pnysical  actions  sucn  as 
activate,  insert,  etc.,  ano  tne  latter  primarily  involve  mental  actions 
sucn  as  ooserve,  decide,  verify,  etc.  we  useu  tne  iuentifieu  IP  tasks  as 
tne  oasis  upon  wnicn  to  generate  suecific  information  required  as  v<ell  as 
display  options  that  are  currently  availaole.  Kesults  of  that  analysis 
are  Shown  in  Taole  Li-1. 

Specific  Skills  tne  instructor  must  nave  to  carry  out  tne^e  tasKs  are 
varieo,  Tne  type  of  tasks  performeu  Dy  tne  IP  ano  tneir  relationship  to 
tne  process  oseo  ano  tne  typical  uenavior  or  skill  requireu  are  oepicteu 
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Table  G-l.  Task  Analysis  Summary 


Table  G-l  (Continued) 


in  Table  iw. 


For  the  IP  to  perforin  nis  duties  efficiently  ne  must  posseaa  a 
variety  of  inherent  Knowledges  in  addition  to  the  specific  sKills.  Tne 
IP  must  know  now  tne  simulator  reacts  to  control  inputs  anu  wnut  its 
limitations  are.  He  must  also  Know  tne  operational  role  of  tne  siniulateu 
system,  its  missions  anu  intended  use.  K.oowleuye  of  simulator  operation 
is  Quvioosly  required.  The  training  pnilosopny  underlying  tne  content 
and  order  of  items  in  tne  training  syllauus  as  well  as  tne  manner  in 
whicn  it  must  be  folluweu  should  also  ue  Known  anu  unutrstoou  oy  tne 
instructor  pilot.  Tne  monitoring  of  stuuent  performance  at  tne 
instructor's  console  for  tne  purpose  of  evaluation  requires 
considerations  oaseu  on  this  pnilosopny. 

Knowledge  of  tne  student  pilot :s  relevant  oaCKgrounu  of  experience  ia 
also  required  as  it  may  impinge  on  tne  approach  to  oe  useu  in  training. 

To  train  a  pilot  to  fly  a  jet-powereu  airplane  wnen  nis  prior  experience 
was  limited  to  propel ler-oriven  macnines  woulu  involve  a  conaiuerauly 
different  process  than  training  someone  wnose  flying  experience  incluueu 
an  airplane  which  was  closely  similar  to  ine  one  he  is  learning  to  fly. 

The  joo  Knowledge  required  of  tne  iP,  as  well  aa  specific  activities 
involved,  oeyenos  on  tne  mission  anu  operational  characteristics.  iH  jou 
knowledge  requireu  to  perform  flignt  simulation  training  uuty  is  shown  in 
Taule  G->. 
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Table  G-2.  Instructor  Filet  Tasks,  Processes,  and  Skills 


Task 

P recess 

Sk_i_Vj_ 

Search  for  &  receiving 
information 

Perceptual 

Detect,  inspect, 
observe  and  scan 

Identify  objects  or 
events 

Discriminate,  identify, 
locate 

Process  information 

i  Kf.  1  C  (,  1  Ol-*1.  J 

Categorize,  calculate, 
code,  compute 

Probl em  sol vi ng/de- 
cision  making 

Analyze,  choose 

Communi eating 

Vocal 

Advise,  answer ,  direct, 
i nform 

Simple/discrete 

Motor 

Activate,  connect,  join, 
set 

Complex/continuous 

Adjust,  align,  regulate, 
synchrony ze 

IP  Knowledge  Requirements 


nKnoyo  >:ove 
s,jmis 

X  X 

3DVJ*d‘JlWI 

3NIH31WKVW 

X  X 

AlldVniWVJ 
S3 1 13  VI. 

i 

><  X  X  x 

! 

iN3ii9anr 

IVOIDOlGlDASd 

X  X 

S3I1D!  l:i!37!l 
9MNim 

1 

X  X 

! 

r. 

1 

I' 


136 


Information  'lequirements 

During  trie  analysis  of  tne  IP's  role  anu  uuties,  we  concluueu  tnat 
nis  joo  in  simulator  training  can  oe  generally  cateyorizeu  into  five 
major  functions:  (1)  simulator  set-up,  (,/)  prooleiii  set-up,  1.0) 
simulator/stuoent  performance  monitoriny  anu  assessment,  v4) 
communications,  anu  (:>)  on-line/off-line  ueuriefiny. 

Altnougn  1US  displays  coulo  oe  useu  in  tne  performance  of  all  of 
these  functions,  tne  tniru  function,  monitoriny  anu  assessment  of 
performance,  appeared  to  oe  tne  appropriate  focus  for  tnis  study,  in 
reviewing  tne  IP's  monitoring  duties,  four  general  categories  were 
identifiei  \.l)  monitor  only  (.results  in  no  specific  action),  u) 
inonitor-reeoru  (results  in  IP  recoruing  information),  t.3) 
monitor-aecioe-act  (results  in  a  uecisiun  wnicn  forces  some  Kino  of 
action)  ana  (4)  monitor-analyze  (results  in  on-line  assessment  of 
system/stuoent  performance. 

Information  type  anG  manner  of  oisplay  reguireu  oy  an  IP  uepenos  on 
the  operational  situation.  Tne  relationship  oetween  tne  atorementioneu 
categories  of  monitoring  duty  anu  mission  segments  selecteu  is  shown  in 
Taole  U-4.  Display  information  requireu  uy  tne  iP  was  ueriveu  uaseu  on 
uetaileu  task  analysis  of  ootn  tne  stuuent  anu  tne  IP,  tne  results  of 
wnicn  were  presentee  earlier  in  laule  u-1. 


Table  G-4 .  Function/Task  Allocation 
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iV.  btNCHMAkk  lAbis 


tJencnmark  (ask  Criteria 


To  oe  a  suitaole  Deneninark  tas><,  cne  tasK  must  oe  one  wnicn  can  ne 
used  to  evaluate  tne  effectiveness  of  different  displays  in  meeting  a 
wiue  variety  of  IP  information  requirements,  nceuruinyly,  criteria  fur 
tee  development  of  the  Deneninark  task  must  include:  til  criticality,  k/.) 
frequency,  (.*■>)  complexity,  (,*+)  measuraoi 1 ity ,  tc;  imnlementaoiiity  to 
multi -cockpit  monitoring.  Tnese  criteria  are  expl.eineu  in  cne  following 
discussion. 

driticality.  Tne  tas*  developed  must  oe  one  wnen  includes 
information  tnat  is  oasic  to  the  success  of  tne  iP  performing  nis 
function.  Since  inuen  of  tnis  information  will  vary  from  maneuver  to 
maneuver,  tne  uencTmiark  tuSK  srioulo  contain  information  elements  tnat  are 
oo tn  critical  ana  common  across  a  large  nuinuer  of  maneuvers,  for 
example,  trie  requirement  fur  airspeed  information  is  critical  to  many 
maneuvers  anu  is  controil^u  solely  py  actions  of  tne  siuuent.  on  tne 
otner  nano,  wn.Uc  fuel  pressure  inf urination  would  De  critical  to  tne 
stuuent  in  tne  event  of  a  fuel  pump  failure,  tnis  failure  wuulu  nave  ueen 
instigated  uy  tne  instructor,  anu  tnerefure,  tne  information  would  not  oe 
critical  to  tne  instructor. 

Frequency.  Tne  oencinnorK  tasK  snouio  contain  suutaSKs  wnicn  are 
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frequently  performed  oy  the  iP.  As  useo  here,  frequency  includes  uotn 
the  amount  of  time  spent  performing  a  function  anu  tne  numoer  of  times, 
tne  function  is  performed.  As  with  tne  criterion  of  criticality,  for  a 
function  to  satisfy  tne  criterion  of  frequency,  it  snoulu  oe  cunsiuereu 
frequent  across  a  significant  numoer  of  flignt  maneuvers.  Pur  example, 
the  turn  anc  oanK  indicator  is  monitored  witn  nign  trequency  curing 
particular  maneuvers  out  is  seldom  monitored  at  otner  times.  Monitoring 
of  altitude,  however,  is  virtually  continuous  curing  all  phases,  of  flignt 
ana  would  unquestionaoly  meet  tne  frequency  criterion. 

Complexity.  Tne  iP  joo  is  complex.  He  must  ooserve  anu  integrate 
data  to  determine  if  tne  aircraft  is  at  the  oesireu  point  in  space,  at 
the  desireo  speed  or  aceleration,  ana  wnetner  or  not  tne  aircraft  is 
properly  configured  (power,  trim,  etc.)  to  prouuce  tne  oesireu 
performance,  for  tne  uencnmarx  tasx  to  ue  valiu,  it  must  require  tne  IP 
to  perforin  sucn  complex  functions. 

Measurauility .  for  tne  oenchmarK  tasu  to  meet  tne  criterion  of 
measuraoility ,  it  must  lenu  itself  to  tne  taning  of  quantitative 
measures.  Tnis  will  nelp  ensure  that  tne  display  evaluation  is  oojective 
ratner  than  suujective.  Tnat  is,  tne  aeriveu  figure  of  merit  for  a  given 
display  must  ue  cased  on  now  effectively  or  efficiently  tne  information 
required  oy  tne  IP  has  been  uisplayeu  as  opposed  to  now  well  tne  iP  iiKeu 
tne  display. 


Implement-anility.  As  useu  nerein,  tne  criterion  of  imp lemon taoility 
refers  to  tne  ease  with  union  the  uencnmar*.  tasK  can  oe  used  in  a 
laooratory  set tiny  for  the  evaluation  of  alternative  displays.  Inis 
requires  that  tne  source  oata  for  tne  generation  of  information  to  oe 
displayeo  oe  in  a  format  wnicn,  if  not  common  to,  is  at  least  easily 
aoaptaole  to  present  ana  antic ipateo  uisplay  hardware. 

Multi-CocKpit  Monitoring.  Tne  estaolisnment  of  a  oencninar*  tasK 
suitaiole  for  use  in  tne  evaluation  of  oisplays  to  oe  useu  for 
multi-coCKpit  monitoring  requires  t.nat  tne  information  presented  ue  taKen 
from  maneuvers  conaiaereo  reasonaule  canoioates  for  multi-cocKpit 
instruction. 

i 


flencnmarx  Tjsk  development 

A  review  of  tne  IIJ  Jou  Analysis  reported  in  section  in  of  this 
apppnoix  reveals  that  tne  IP’s  prime  function  is  to  monitor. 

Furthermore,  information  relative  to  Oasic  aircraft  tliynt  parameters  is 
requireu  oaring  all  pnasPs  of  fliynr  regardless  of  tne  procedure  or 
maneuver  ueiny  flown,  while  a  wiue  variety  of  maneuvers  of  varying 
length  ano  complexity  could  ue  useu  to  generate  tne  information  wnicn 
would  satisfy  tne  uencninar*  tasK  criteria,  five  uusic  fliyht  maneuvers, 
climu  anu  level-off,  descent  ano  level-off,  level  turn,  climuiny  turn, 
anj  oescenuiny  turn  were  selected  on  tne  uasis  ot  tneir 
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comprehensiveness,  representativeness,  anu  simplicity.  Analysis  of  tnese 
maneuvers  reveals  tfiat  tne  transition  ana  steauy-state  conuitions  coulo 
oe  strung  togetner  in  a  manner  wnicn  woulo  oescrioe  almost  any  flignt 
maneuver,  rtnile  this  concept  may  nave  certain  limits,  tne  maneuvers 
selected  are  considered  to  generate  tne  majority  of  in'  information 
requirements  relative  to  tne  monitoring  of  aircraft  control  performance. 
Tne  IP  information  requirements  generated  oy  tnese  maneuvers  are 
representative  of  those  founu  in  most  flignt  training  situations  ano 
satisfy  tne  criticality,  frequency,  ano  complexity  criteria.  The 
parameters  useu  to  define  tnese  maneuvers  lenu  themselves  to  tne 
collQction  of  quantitative  uata  as  required  oy  tne  measuraui lity 
criterion,  in  view  of  tne  fact  that  tne  maneuvers  are  not  very  complex 
ana  can  pe  adequately  displayep  tnrougn  inuicatipns  of  five  fiiynt 
parameters,  i.e.,  airspeed,  attitdae,  altitude,  vertical  velocity,  anu 
heading,  tnere  snoulo  ue  very  little  proulem  uevelopiny  source  data  to 
implement  tne  uencnmarx  tasK  on  a  wioe  variety  of  displays,  rurtnermpre, 
tne  maneuvers  anu  the  taSK  of  monitoring  fliynt  instruments  are  typicd 
of  what  is  expected  to  oe  encountered  in  a  mullicocxpil  monitoring 
situation. 

In  summary,  tne  oencninarK  tasx  oevelopeu  for  tnis  effort  consists  of 
monitoring  five  flignt  parameters  witspeea,  attltuue,  altitude,  vertical 
vplocity,  and  heading)  during  ten  fliynt  seyments  conaistiny  of  two 
repetitions  of  five  uasic  flignt  maneuvers  volimo  anu  levei-uff,  descent 
ana  level-of f ,  level  turn,  climuing  turn  anu  uescenuin^  turn).  Tne 
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manner  in  which  the  flight  segments  were  developed  ano  presentee  and  the 
manner  in  whicn  the  oenchmarK  tasK  was  performed  and  tested  are  coverea 
in  detail  in  Section  VI  of  tnis  Appendix. 


V.  PtKFQRMANCt  MlASUHlS 

Tne  oojective  of  this  pnase  of  the  effort  was  to  uevelop  performance 
measures  wnich  would  discriminate  tne  relative  effectiveness  of 
alternative  display  formats  ano  configurations.  Display  effectiveness  is 
oest  defined  as  the  aoility  of  a  display  to  impart  aesireo  information  to 
an  ooserver.  In  tnat  there  are  no  means  to  directly  measure  tnis 
ability,  it  was  necessary  to  devise  some  means  of  determining  now  muen 
displayed  data  had  in  fact  oeen  perceiveu  Dy  tne  ooserver.  Since  tne  IP 
cannot  respond  to  something  ne  has  faileo  to  notice,  tne  most 
straightforward  way  to  measure  display  effectiveness  is  to  determine 
whether  tne  information  on  the  display  was  noteo  oy  tne  iP  any,  if  so, 
how  much  of  it  was  retained.  Accordingly,  tne  proceaure  developed  to  ao 
this  required  suojects  to  observe  displayed  fliynt  information  generates 
oy  a  series  of  short  simulated  flight  segments  ano  to  respond  to 
questions  concerning  tne  values  of  certain  of  tne  oisplayeu  flignt 
parameters  at  specific  points  curing  the  segment.  Tnis  approach  is 
desirable  in  that  a  response  may  oe  ootaineo  regaroless  of  tne  quality  of 
flight  or  the  ooserver' s  Knowleaye  of  such  tninys  as  correct  proceoures 
or  aircraft  performance  characteristics.  Tne  ooserver  is  not  required  to 
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judge  tne  goodness  of  what  ne  nas  ooserveo  out  merely  to  report  tnat 
which  has  been  ooserved. 

On  tine  basis  of  tne  IP  information  requirements  oetermineu  uuriny  tne 
IP  task  analysis  (see  Taule  u-z),  we  developeo  eiynt.  questions  for  eacn 
of  tne  five  basic  maneuvers.  Tne  manner  in  wnicn  tnese  questions  were 
employed  to  collect  data  is  uiscusseu  in  octail  in  Section  Vl. 

There  was  no  clear  way  of  estaolisniny  wnat  limits  snoulu  oe  set  fur 
scoring  a  response  as  "correct";  therefore,  we  examinee  tne  collecteu 
data  and  selected  limits  wnicn  woulo  proviae  maximum  sensitivity  to  tne 
effects  of  various  conditions.  Since  tnis  was  not  an  evaluation  of 
displays  but  ratner  a  search  for  a  feasiole  means  to  evaluate  suen 
displays,  this  was  consiaereo  to  De  Doth  a  proper  ana  necessary  manner  in 
which  to  proceed. 

In  scoring  responses  to  the  questions  on  altituue  or  vertical 
velocity,  a  response  in  error  greater  than  >UU  feet  was  consiaereo 
incorrect  and  scored  zero,  an  error  of  less  than  sui)  feet  was  consiaereo 
correct  ana  scored  one.  Tne  choice  of  SUO  feet  as  a  cut  off  point  was 
Dased  on  a  first  cut  analysis  of  tne  raw  data  wnich  indicated  that  sou 
foot  cut  off  point  would  provide  a  measure  witn  good  sensitivity  to 
variability  of  performance.  Similar  rationale  lea  to  establish  a  five 
degree  error  limit  for  heading,  roll,  ana  pitch  ana  a  corresponding  ten 
knot  allowable  margin  for  airspeed. 
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In  tne  absence  of  sufficient  uata  to  estaolisn  statistically  reliaole 
response  distriputions,  no  attempt  was  made  to  give  differential  credit 
for  more  accurate  responses. 

In  summary,  tne  metric  of  display  effectiveness  useu  was  an  inuireet 
measure  Dased  on  the  percentage  of  correct  observer  responses  made  to 
questions  aoout  displayed  flight  information,  wnere  the  criteria  for 
"correctness"  were  estimateo  ay  the  investigators. 


VI.  OtMUNSTHATluN  Anl)  TtST  PrtUCtUUKt. 


Approach 

As  stated  previously,  the  oojective  of  this  research  was  to  develop  a 
means  of  evaluating  the  relative  effectiveness  of  candidate  fliynt 
simulator  instructor/operator  station  displays.  Tne  approacn  ta*en  was 
to  develop  a  pencnmark  task  ana  performance  measure  sucn  tnat  wnen  tne 
oenchmark  task  was  performed  using  alternative  displays  ano  tne 
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could  be  determined.  Toward  tnis  enu,  tne  Dencnmark  task  estaulisneu  was 
one  whicn  required  an  ooserver  to  view  prerecorded  flignt  information  on 
a  candidate  display  ano  to  respond  to  questions  aoout  tne  displayed 
information. 
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General  Discussion.  To  demonstrate  the  aoove  approacn  anu  to  test 


its  feasibility,  four  test  observers  performed  the  benchmark  task  using 
both  an  analog  flight  instrument  display  and  a  CKT  digital  display.  Tne 
test  conducted  was  a  first  look  at  the  feasibility  of  the  oenchmarK  task 
approach  and  as  such  did  not  produce  sufficient  data  for  rigorous 
statistical  analysis.  However,  it  was  considered  to  oe  a  reasonable 
compromise  between  a  vigorously  quantitative  test  ana  a  purely  suojective 
one. 


Test  Suojects.  four  test  subjects  were  useo  for  this  test.  Three  of 
the  subjects  were  well  qualified  pilots  witn  prior  military  flying,  over 
3,000  pilot  hours,  and  experience  as  instructor  pilots,  qualification  of 
the  fourth  suoject  was  limited  to  flying  experience  of  aoout  4U  hours  of 
piloting  a  light  plane  under  visual  flight  rules  (Vr'K>  conuitions  only. 
Tne  rationale  for  including  a  subject  with  minimum  experience  was  to  gain 
some  initial  Data  on  whether  or  not  extensive  prior  experience  using  a 
standard  instrument  display  might  inhibit  tne  experieneea  pilot's  ability 
to  work  with  a  non-stanaara  aisplay  format,  viz.,  tne  CKT  digital 
display,  o'  otherwise  bias  the  data  in  favor  of  the  stanaaru  aisplay. 
Presumably,  tne  nighly  experienced  pilot  would  have  a  relatively  greater 
aifficulty  with  the  strange  format  than  someone  wno  was  not  overpracticeu 
with  the  standard  instrument  display.  Tne  preliminary  test  tnus 
represented  a  broad  range  of  experience,  ana  inaiviaual  differences  in 
aoility  on  tne  task  were  accentuated  uy  tnis  selection. 


Test  Material.  Toe  displays  representing  tne  five  maneuvers 
previously  ciscusseu  constituted  tne  test  materials  of  tne  ueneninai'K 
tdSK.  Tne  two  types  of  displays  uses  were  stanuaru  fliynt  instruments 
anu  digital  presentations  on  tne  CR T.  Tne  instrument  panel  nau  tne 
airspeeu  inoicator,  tne  attitude  inuicator  (.artificial  norizon),  tne 
vertical  velocity  indicator,  neaoiny  indicator,  anu  tne  altimeter.  Tne 
arrangement  of  fliynt  indications  on  the  CRT  was  identical  to  tne 
instrument  panel.  No  other  instruments  in  the  instrument  panel  were 
activated.  On  tne  CRT,  all  of  tne  indications  were  presented  in  digital 
form,  wnite  on  olacK  uaCKgrouno.  For  pitch  anu  roll  information,  tne 
symools  "UP,"  "l)N,"  "l,"  ano  "K"  appeared  to  tne  left  of  tne  digits  as 
appropriate. 

Tn»  ckT  was  located  just  aoove  tne  instrument  panel  at  tne  same 
viewing  distance  as  the  analoy  instruments.  Tne  information  was 
displayed  simultaneously  on  tne  instruments  anu  CRT.  ine  ckT  unit  riau  a 
cover  wnicn  couiu  oe  positioned  over  tne  tuue  face  wnen  tne  information 
was  to  fie  viewed  on  tne  instruments,  instruments  were  liKewise  covereu 
when  tne  CRT  was  exposed. 

Test  Facility.  Tne  experiment  utilized  a  general  purpose  simulation 
facility,  multi-mission  simulator  (MMS)  developed  for  conducting  research 
requiring  man-in-tne-loop  simulation. 

Figure  u-Z  is  a  oIock  diagram  snowing  tne  major  elements  of  tne 
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Figure  G-2.  Major  Elements  of  Flight  Simulator 


flignt  simulator  utilized.  "CANNtu"  missions  were  provided  u y  f'l/iny 
closed-loop  man-in-tne-loop  mission  segments  ano  recuruing  the  uilot 
input  commands  to  tne  digital  computer. 

T ne  Varian  7o  computing  system  solves  tne  equations  or'  motion  of  a 
representative  fignter  aircraft  anu  pruviues  simultaneous  uisplay  inputs 
to  a  Sanders  Ados  ^OU  grapnics  system  anu  to  tne  flignt  instruments  in 
tne  simulated  fignter  cau. 

Tne  Sanpers  grapnics  system  provides  digital  .information  for  display 
on  a  10-incn  Hewlett-Packard  louuA  UKT.  Tne  uiyital  information 
displayea  on  tne  uHT  represents  tne  same  type  of  information  proviueu  to 
cne  analog  flignt  instruments  (.altitude,  attitude,  anu  neauiny). 
Simultaneous  information  was  provided  to  uotn  tne  ukT  anu  tne  flignt 
instruments.  Special  masKa  were  used  over  tne  displays  wnicn  allowed  tne 
test  suoject  to  view  eitner  tne  analoy  flignt  instruments  or  tne  digital 
display  on  tne  <JKT. 

Only  tne  rear  station  of  a  two  station  cocKpit  was  utilized,  anu  tne 
HewlPtt-PacK.ara  CRT  was  mounted  directly  auove  trie  rear  station  flignt 
instrument  panel.  Tne  arrangement  of  tne  analoy  flignt  instruments  was 
as  snown  in  Figure  U-i. 

Existing  software  was  used  wnicn  nau  ueen  developed  for  an  Advanced 
Tactical  Fignter  Simulation.  Tnis  program  was  maue  up  of  standard 
modules  ana  aircraft-unique  modules.  Tnere  were  six  standard  muddles 
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Arrangement  of  Analog  Instruments  in  Crew  Station 


used  in  tnis  simulation,  Four  of  tnuse  t transformation  matrix,  equations 
of  motion,  integration,  ana  aircraft  relateo  quantities)  proviueu  tne 
capadility  to  determine  tne  aircraft  trajectory,  orientation,  anu  uynumic 
response.  The  remaining  two  stanuaro  modules  tatrnospnere  anu  winds,) 
provided  tne  natural  environment  surrounuiny  tne  aircraft.  Tne  equipment 
used  included  two  Varian  75  minicomputers  witn  lo-oit  worus  of  memory 
each.  One  computer  was  useu  to  drive  tne  graphics,  anu  tne  secunu  was 
used  to  simulate  tne  fiynter. 

Test  Procedure.  Tne  five  maneuvers  were  flown  four  times  eacn  two 
duplicates  of  eacn  maneuver  un  eacn  of  tne  two  uisplay  formats,  fur  a 
total  of  twenty  flignt  segments.  Prior  to  presenting  tr.ese  to  tne  test 
suojects,  tne  flignt  segments  were  ranouinizeu.  cignt  questions  were 
generated  (Appendix  1)  for  eacn  of  tne  five  maneuvers  arm  tnese  were  also 
ranuomizeo.  Tne  randomized  displays,  questions,  a.no  flignt  segments  are 
shown  in  Appendix  J.  A  randomized  set  of  four  questions  was  given  after 
tne  first  replication  of  a  given  maneuver  shown  on  a  uisplay,  anu  tne 
remaining  four  were  given  after  tne  secunu  replication  of  tne  same 
maneuver  snown  on  tne  same  uisplay.  specific  test  procedures  fur  eacn  of 
tne  suojects  were  us  follows: 

Tne  suuject  was  seateu  in  tne  cockpit  ut  tne  mmS  witn  tne 
exp^rimentej  sitting  uesiue  him  uutsiae  tne  coCKpit.  He  was  given 
writt°n  uriefing  material  to  read  consisting  of  general  instructions 
the  effect  tnat  all  tne  participant  was  required  to  uo  was  to  ouserve 
indications  as  uirecteu  on  either  tne  analog  instruments  or  on  tne  ukT. 
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After  the  subject  fj.nisr.ea  reccing  tne  briefing  instructions,  ne  was 
shown  now  to  position  a  special  masK  to  occluoe  tne  indications  un  tne 
display  whicn  he  was  not  to  use.  ana  now  to  expose  tnose  ne  was  to  use. 
(During  tne  test,  tne  experimenter  ensures  tnat  tne  proper  uisplay  waa 
indeed  occluded. )  Tne  ouserver  was  tnen  given  a  typeo  set  of 
instructions  regaroing  nis  task  (.Appenaix  u).  Tnese  were  intenueu  to 
prepare  nim  for  tne  kinos  of  questions  ne  woulu  oe  askeu.  Tne  subject 
was  then  presenteo  witn  a  ranuomizeu  fliynt  segment  on  one  of  tne  two 
displays  for  a  duration  of  l-o  minutes  (.uepenoing  on  tne  particular 
flight  segment).  At  tne  conclusion  of  tne  presentation,  ne  was  askeu 
four  pre-randomizep  questions  oy  tne  experimenter.  Tnis  proeeaure  was 
repeated  for  eacn  of  tne  Zu  flignt  segments,  witn  a  five-minute  ureaK 
after  lu  flight  segments.  Tne  session  for  eacn  suoject  was  completes  in 
approximately  one  and  a  naif  hours  incluuing  tne  preak.  Tne  subjects  nau 
no  practice  on  eitner  of  tne  test  Displays  prior  to  tne  actual  testing. 

After  all  four  suujects  nau  completed  tne  experiment,  tney  were 
p^oriefpd  in  an  informal,  unstructureu  manner.  Tne  results  of  tnis 
deuriefiny  are  treated  in  Section  Vj.1.  iKesults  any  Discussions; . 


vii.  Ktsuds  and  uisuuSSiun 

The  test  conuucteu  was  concerneu  primarily  witn  Demonstrating  tne 
feasibility  of  tne  oencnmark  task  appruacn  for  tne  evaluation  of  uisplays 
to  ue  uses  at  a  remote  luS.  Since  insufficient  uata  were  taken  to 
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perforin  statistical  tests  of  Differences,  tne  only  "analysis'1  performeu 
on  tne  data  was  tne  summing  of  correct  responses  across  tne  several 
factors. 

Overall  performance  (all  suDjects  ana  all  fliynt  segments)  was 
derived  oy  summing  all  trie  correct  responses  oy  four  suojects  to  tne 
questions  aoout  tne  twenty  flignt  segments  vieweo  on  two  Displays,  anu 
aiviaing  tnat  sum  oy  tne  total  numoer  of  questions  asKeo.  Tne  resultant 
outcome  of  tnis  calculation  of  06 %  was  a  fortunate  one  in  tnat  it  is  in  a 
range  wnicn  allows  for  variaoility  in  ootn  airections.  uuviously,  a  mean 
percentage  of  control  responses  close  to  le ro  or  one  nunureo  woulu  nave 
forced  tne  qistrioution  to  oe  SKewea  anu  woulu  nave  inuieateu  tnat  tne 
questions  were  eitner  too  difficult  or  too  easy. 

Tne  major  factor  in  tne  test  was  Display  type,  we  expecteu  tnat  tne 
standard  instruments  would  pruve  more  efficient  for  use  oy  tnose  already 
familiar  witn  tnis  type  of  oisplay  tnan  tne  ull-uiyital  display  on  tne 
CRT.  Tne  results  support  tnis  expectation  in  direction  uut  not  in 
magnitude  of  the  difference,  pcs*  correct,  for  instruments  anu  o4x>  for 
cki.  Tnis  small  difference  woula  not  liKely  oe  statistically 
significant,  considering  tne  relatively  Jarye  variauility  due  to  otner 
factors.  It  snould  ue  noted,  However,  tnat  nao  urn  metnou  of  acoriny 
oeen  more  sensitive,  e.g.,  differential  rati.er  tnan  uinary,  tne  magnituue 
of  tne  difference  mignt  oe  mure  substantial. 

As  snpwn  in  Taule  G- 5,  the  range  in  scores  (80%  to  55%)  due  to  pilot 
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differences  witn  instruments  is  15  percentage  points,  wnile  witn  tne  CkT, 
it  is  30  percentage  points  7 x%  ana  k'jTa) .  Tnis  is  six  to  seven  tiir.es  tne 
range  in  scores  due  to  atsplay  differences  6d?i>  and  o4*.  if  we  compare 
correct  responses  for  individual  suojects,  we  see  t.nat  Pilot  A 
distriouteo  his  correct  responses  nearly  evenly  DCtween  tne  two  uisplays, 
Pilots  6  and  C  gave  55%  and  34*  of  tneir  correct  responses,  respectively, 
to  instruments,  ana  Pilot  0  gave  only  4o*  of  nis  correct  responses  to 
instruments.  Pilots  A,  6,  anu  0  nave  many  nours  of  experience  looKiny  at 
instruments  wnile  Pilot  C  nas  only  a  few  and  all  of  Pilot  C's  flying  nas 
oeen  VfK.  Tnus,  tne  experience  factor  ooes  not  seem  to  account  for  tne 
differences  among  pilots  in  tnis  study. 

We  might  note  furtner  tnat  less  experienceu  Pilot  C  not  only  was  tne 
top  performer  with  instruments  out  also  snpweu  tne  largest  difference  in 
favor  of  instruments.  One  miynt  nave  tncugnt  tnis  pilot  wouiu  nave 
performed  relatively  uetter  witn  tne  (JKT  display  tnun  would  tne  pilots 
with  long  experience  using  instruments.  Pilot  u  disc  nau  tne  oest 
performance  overall,  wnicn  also  was  a  finaing  not  pr  aicteg.  Although 
iooK.ing  for  "reasons"  oenind  tne  ouserveu  differences  amony  suojects  is 
merely  speculative,  one  is  tempted  to  suggest  tnat  tne  superior 
performance  of  Pilot  C  may  De  due  to  youtn  more  tnan  anything  else. 
Profering  an  alternate  potential  explanation,  it  miynt  pe  suyyesteu 
tnat  a  lot  of  experience  leaus  piluts  to  ue  more  selective  in  tneir 
monitoring  of  flight  indications. 

Comparing  display  formats  at  tne  level  of  tne  inuiviuual  maneuvers, 
we  ooserve  differences  of  an  inconsistent  nature,  in  two  of  tne  five 
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maneuvers,  the  total  percent  correct  responses  over  dll  suojects  is 
numerically  higner  for  tne  CUT  display,  mo  inferences  are  prawn  witn 
regard  to  tne  confidence  to  oe  placea  in  such  an  ooservation  ^as  witn 
otner  ooservations  in  tnis  discussion)  uut,  on  tne  otner  nanu,  it  woulu 
weaken  any  tendency  to  take  seriously  tne  overall  performance  uifference 
in  favor  of  instruments. 

As  to  tne  differences  in  correct  responses  for  tne  various  maneuvers, 
tne  data  sorted  in  tnis  way  are  very  naru  to  interpret.  Tne  eiynt 
questions  for  eacn  maneuver  were  not  yenerateu  witn  a  requirement  tnat 
they  oe  of  equal  difficulty  amony  maneuvers,  ivot  even  tne  simplicity  of 
tne  maneuver  is  reflected  in  any  consistent  way  in  tne  responses,  wny 
snoulo  a  climoing  turn  De  more  difficult  to  monitor  tnan  a  uescenoiny 
turn?  But  tnen,  we  nave  no  reason  to  assume  equivalence  in  tne 
conditions  present  in  tne  test. 

When  tne  data  are  summari/.eu  oy  maneuver  anu  fliynt  inuication 
(Appendix  L),  tne  numoers  in  individual  cells  are  too  small  td  uisCuss, 
out  in  a  larger  study,  one  may  De  aule  to  place  fliynt  inuications  in 
order  of  importance  anu  monitoring  difficulty.  Since  tne  same  flights 
weru  seen  wnere  instruments  were  monitored  as  wnen  tne  inuications  were 
presented  on  tne  CUT,  anu,  similarly,  tne  same  questions  were  asKeu,  we 
may  assume  that  wnere  differences  uetween  tne  two  displays  are  large, 
tnex-p  is  a  strong  suggestion  that  tne  cuserveu  uifference  woulu  nolu  up 
in  a  lary^r  stuuy.  for  example,  questions  auout  altitude  were  answereu 
correctly  7d^  of  tne  time  when  tne  information  was  reau  from  tne 
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instruments  out  only  5Ufc  of  trie  time  from  tne  CRT,  kqII  also  was  reau 
more  often  correctly  (and  rememuerea)  witn  tne  instruments,  i'u*  as 
opposed  to  6U%  of  tne  CRT.  un  tne  otner  nano,  pitcn  questions  were 
scored  correct  only  i>6%  of  tne  time  with  instruments,  out  bl*  wit.it  tne 
CRT.  Tne  otner  tnree  flignt  indications  snow  mucn  smaller  uifferences 
detween  displays. 

One  would  expect  to  see  learning  over  tne  course  of  tne  twenty  flignt 
segments  Decause  of  tne  unusual  cnaracter  of  tne  tasx.  As  snown  in 
Appendix  m,  two  of  tne  pilots  (b  and  C)  sr.ow  some  evidence  of  learning 
oased  on  tne  numoer  of  correct  responses  in  eacn  quarter  of  tne 
questions.  However,  pilots  A  ana  0  snown  no  learning  trenus. 

After  all  pilot  ooservers  nau  completeu  tneir  participation  in  tne 
test,  they  were  given  an  opportunity  to  express  tneir  opinion  auout  tne 
techniques  used.  They  inoicatea  tnat  tne  tasK  was  a  difficult  one, 
primarily  oecause  tney  did  not  Know  wnat  tne  maneuver  was  to  ue  or  wnat 
questions  they  woulu  ne  asKeu.  Tney  pointed  out  tnat  in  flying  to  an 
artificial  norizon  tney  are  less  interested  in  tne  specific  values  if  tne 
airplane  is  in  tne  attituoe  tney  intend  it  to  oe  in,  whereas  tne  CRT 
display  required  them  to  reau  tne  digital  presentation.  Tne  least 
experienced  pilot  missed  tne  "seat  of  tne  pants”  feeuuacK  experienced  in 
a  light  airplane. 

Yiuen  asked  aoout  the  taSK  cf  an  instructor  pilot  as  representeu  in 
the  development  of  uetter  displays  for  an  lub,  they  pointed  out  tne 
individualistic  approach  to  tne  use  of  instrument  inuications,  suggesting 


th  t  one  arrangement  might  not  uest  suit  all  IPs.  Tney  also  felt  tnat 
the  interaction  oetween  IP  ana  stuaent  must  oe  tailoreu  to  tne  situation 
and  tne  personalities  of  cotn.  Snoula  tne  IP  oe  simply  a  cneCKer  of 
student  activity?  Snoula  ne  aaopt  a  tutorial  attitude?  Snoulu  ne  oenave 
liKe  a  martinet?  Snoula  ne  concentrate  on  ouiloing  tne  student's 
confidence?  No  single  answer  can  oe  given. 


VIII.  CONCLUSIONS  ANU  KtCUMi-fcNLlATlUhb 

While  the  scope  of  this  program  aiu  not  permit  quantitative  scaling 
of  responses,  it  aid  allow  for  quantitative  comparison  amony  displays. 
Altnough  tne  evidence  is  not  unequivocal,  tne  test  conaucteo  demonstrated 
that  tne  approach  used  is  feasiDle  for  tne  evaluation  of  displays  ana 
could  prove  useful  in  the  development  of  design  specifications  for 
displays  to  oe  usea  at  a  remote  lub. 

If  more  data  coulu  pe  collected  anu  tne  questions  anu  responses 
refined,  tne  development  of  an  "instructor  pilot  stanuaru  ooserver" 
representing  average  monitoriny  aoilities  ana  tendencies  would  oe 
possiule.  witn  tne  collection  of  sufficient  uata,  standardised  scores 
coulu  Pe  computed  wnicn  would  permit  future  evaluations  to  oe  made 
against  a  scale  having  tne  necessary  statistical  properties. 

A  proolem  associated  witn  tne  approacn  used  is  tnat  tne  IP  quite 
often  tooks  at  the  flight  indications  as  a  group  rather  man  a  set  of 
individual  indications.  Tnat  is,  if  the  eomoination  of  indications  in  a 
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given  instance  is  correct,  trie  iP  may  not  taxe  particular  note  ut'  eacn 
specific  value,  out  merely  satisfy  nimself  tnat  inuications  are  correct 
in  aggregate.  Snouiu  tnis  occur,  altncugn  tne  display  performed  ita 
function  of  proviaing  tne  information,  tne  ouserver  may  not  ue  aule  to 
r^suonu  to  a  question  relative  to  its  value  at  tnat  point  in  tne 
maneuver.  However,  careful  analysis,  to  ensure  tnat  tne  questions  asKeu 
pertain  to  information  cunsiuereo  important  at  a  certain  point  in  tne 
maneuver,  snouiu  minimize  tnis  proulem. 

Anile  every  effort  was  maue  to  develop  d  oencnmarx  tasK  appliCauie  to 
tne  oroauest  poasiole  range  of  if  inonitoriny  functions,  tne  scope  of  tnis 
effort  uid  not  permit  pevelepinent  of  maneuver  segments  wiiicri  would 
generate  all  of  tne  ip  information  requirements.  Auuitiunai  wur«.  is 
required  to  determine  wool  all  of  trie  ir  infuniiatiun  requirements  are. 

Tne  present  study  nas  snown  tnat  one  snouiu  expect  a  wipe  variation 
in  tne  aoility  to  monitor  instruments,  or  otner  uisplays,  even  fur  iiiyniy 
exo-=  rienceu  pilots.  Tnis  may  mean  tnat  IPs,  if  more  carefully  selected 
ano /or  trainee,  could  snow  greater  efficiency  in  tneir  monitoriny 
performance. 

Tne  pe.ncn.nara  tasK  approucn  quite  ouviously  snuulu  unuergu 
consioeraule  refinement  uefore  its  utility  can  ue  vaLiuaCeu.  extension 
pf  tne  present  effort  snouiu  include  tnuruugn  study  ut  tne  traininy 
situations  of  interest.  Pernaps  more  important,  future  studies  neeu  to 
explore  tne  use  of  mure  sensitive  measured  of  performance  on  tne 

instructor  tdsxs  anj  tne  information  neeueu  to  perform 


pencnmarK  tas*. 


them  snoulci  ue  researcneu  more  tnorouynly.  Meaningful  alternative 
approaches  to  display  tecnniques  could  then  ue  compared  for  effectiveness 
and  cost. 

While  tr.is  effort  was  directed  towards  developing  a  means  of 
evaluating  rather  tnan  of  designing  displays,  tne  wofk  evOKeu 
considerable  tnougnt  ano  discussion  relative  to  design.  Tnis  information 
is  summarised  in  tne  following  paragraphs. 

An  effort  snoulo  oe  conducted  relative  to  optimizing  tne  display 
format  according  to  tne  type  of  information.  Pointers  anu  dials  iiiay 
remain  pest  for  certain  indications  out  most  liKely  not  for  all  tne 
indications  they  are  used  for  the  typical  cocKpit.  uoou  inspection  of 
trends,  for  example  would  certainly  ue  easier  wim  a  uisplay  that  allowed 
more  than  tne  present  status,  e.y.,  a  simple  graph  of  flight  status  vs. 
time. 

Tne  type  ana  format  of  information  presentation  is  a  significant 
factor.  For  example,  an  altitude  profile  displayed  on  a  CkT  may  permit 
an  IP  to  Keep  traCK  of  a  stuuent  witn  leas  effort,  un  tne  utner  nanu,  a 
single  digital  indication  may  oe  sufficient  for  tne  recording  of  extreme 
values  for  soinetning  lixe  maximum  u  force  ur  exhaust  gas  t rature. 

Another  way  to  ennance  tne  capacity  of  a  uisplay  anu  tne  speeu  of 
response  or  retention  of  oetails  uy  tne  j.P  is  tne  uc.e  of  a  color  ukI  . 
Color  may  ijp  usep  to  separate  types  of  indications  mure  clearly  or  it  may 
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up  uspp  to  snow  tne  severity  of  d  condition,  e.y.,  reu  for  low  fuel 
reserves  or  angles  of  attdCK  close  to  stall  conditions. 

Tne  constraints  of  tne  cocKpit  environment  snoulo  not  oe  retained  tor 
tne  lUS  if  some  otner  uisolay  tecnnique  will  permit  tne  iP  to  perform  nis 
tasK  more  easily,  if  tne  IP  ooes  not  nave  to  monitor  all  instruments,  ne 
snoulon't  nave  tnem  clutteriny  up  tne  Ids  display  area,  rurtnerinore,  if 
tne  display  format  ennanees  tnose  indications  requiring  nis  attention, 
tnp  rP  may  oe  aule  to  monitor  several  students  at  tne  same  time. 

A  proyram  of  researen  in  iuS  displays  from  tne  stanupoint  ot  Human 
rpsources  snouia  include  a  strong  empnasis  in  visual  perceptual, 
anilities,  differential  sensitivity  associated  witn  retinal  location  are 
particularly  important  in  a  monicoriny  tasK  since  tne  relatively  low 
acuity  in  tne  peripnery  means  tnat  some  way  is  needed  to  uriny  tne 
oosurvur  to  fixate  tne  indication  of  importance  witn  central  nign  acuity 
vision.  (A  flasniny  liynt  nas  oeen  successfully  uspo  for  tnis.) 

In  summary,  tne  uenenmarK  tasK  approacn  to  rus  display  evaluation  is 
consijereu  feasiule  anu  furtner  refinement  anu  investigation  is 
rpcominpndeu. 
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APPENDIX  H:  LITERATURE  SURVEY  ABSTRACTS 


ABSTRACTS  Of  SELW.KT  LITtPAT'Tir 


ABSTRACTS  OF  PCLCV4KT  t ITc 


APPENDIX  I:  TEST  QUESTIONS 


CLIMB  AND  LCYLL  OfT 

Cl  At  what  altitude  did  the  aircraft  start  to  nose  over  to 

levei  flight? 

C-2  What  was  the  highest  altitude  reached? 

C-3  At  level  off,  what  was  the  heading? 

C-4  What  was  the  vertical  velocity  just  before  the  start  of 

level  off? 

C-5  What  was  the  highest  airspeed  in  the  cl i mb? 

C-6  What  was  the  roll  angle  in  the  transition  from  climb  to 

level  flight? 

C-7  What  was  the  maximum  pitch  up  angle? 

C-8  What  heading  changes  were  there,  if  any? 


Correct  Ar.r'  »»rs 

F  I  i  glil  Segment  Number 


Question 

1 

2 

3 

4 

Uni  t 

C-l 

19670 

1 9830 

1 9500 

19700 

ft. 

C-2 

15830 

20010 

i  r't~\  n  n 

IW'ru 

1 9920 

■fi 

1  L#  . 

C-3 

0 

0 

0 

1 

degrees 

C-4 

5800 

8800 

5800 

3100 

f  t/mi n . 

C-5 

3G0 

680 

365 

350 

knots 

Cv6 

0 

0 

0 

1 

degrees 

C-7 

23 

25 

15 

12 

degrees 

C-8 

0 

0 

0 

0 

degrees 

LLVEL  TURN 


LT-9 
LT-10 
LT-1 1 
LT- 1 2 
LT-1 3 
LT-1 4 
LT-1 5 
LT-16 


What  was  the  maximum  roll  angle? 

What  was  the  minimum  altitude  during  the  turn? 

What  was  the  maximum  altitude  during  the  tuv'n? 

At  what  heading  did  the  rcll  out  begin? 

What  was  the  airspeed  just  before  roll-in? 

What  was  the  airspeed  just  after  roil  out? 

What  was  the  maximum  airspeed  in  the  turn? 

What  was  the  minimum  airspeed  in  the  turn? 


Correct  V"'-ers 


Question 

5 

flight  Segm, 
6 

.nit  Number 
7 

8 

Uni  t 

LT-9 

34 

32 

28 

33 

degrees 

LT-10 

19810 

20030 

19710 

19690 

ft. 

LT-1  1 

20400 

20960 

20100 

20680 

ft. 

LT-1 2 

131 

176 

9? 

263 

degrees 

LT-1 3 

280 

266 

270 

276 

knots 

LT-1  4 

27  b 

245 

270 

266 

knots 

LT-16 

280 

260 

296 

290 

knots 

LT-16 

276 

236 

266 

270 

knots 

L'ESCENT 


D- 1 7 

n- 13 


D- 19 
D-  20 
D-21 
D-22 
P-23 
P-24 


Qu£S_Limr 

0-17 
D- 18 
P-19 
P-20 
P-21 
P-22 
P-23 
P-24 


What  was  the  pitch  angle  when  the  nose  .-.•as  lowest? 

What  was  the  airspeed  just  befo""'  the  aircraft  nosed  over 
for  the  descent? 

What  was  the  airspeed  just  after  level-off? 

What  was  the  altitude  prior  to  the  descent? 

What  was  the  altitude  after  the  descent? 

What  was  the  initial  heading? 

What  was  the  heading  after  level  off? 

What  was  the  maximum  roll  angle  {left  or  right)? 


Correct  Answers 


flight  Segment  [lumber 


9 

.  ^  ■  ■  -  '  -  j-- 

10 

11 

12 

Uni  t 

-1 

-7 

- 

-8 

degrees 

310 

285 

255 

290 

knots 

31b 

300 

28  5 

295 

knots 

20000 

20220 

201  2d 

20240 

ft. 

15370 

1 5100 

15490 

in  vn 

•  ~j  \  t  kj 

4  J 

1  d  . 

0 

~0 

0 

0 

degrees 

0 

0 

2 

0 

degrees 

0 

0 

2R 

HR 

degrees 
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CLIMBING  TURN 


CT-25  What  was  the  airspeed  just  afier  roll  out? 

CT-26  At  what  heading  did  the  roll  out  begin? 

CT-27  At  what  heading  did  the  roll  out  begin? 

CT-28  What  was  the  maximum  pitch-up  angle? 

CT-29  What  was  the  highest  airspeed  in  the  climb? 

lT-30  What  was  the  vertical  velocity  just  before  start  of  level 

off? 

CT-31  At  level  off,  what  was  the  heading? 

Cl - 32  At  what  altitude  did  the  aircraft  start  to  nose  over  to 
level  flight? 


, Correct  Auskp rs 


flight  Segment  Number 


Ques  tjon  13  14 


CT-25 

345 

255 

CT-26 

126 

122 

CT-27 

40 

27 

CT-28 

9 

19 

CT-2C 

350 

270 

Cl -30 

3050 

4000 

CT-31 

127 

122 

CT-32 

19750 

19800 

15 

16 

Unit 

335 

400 

knots 

107 

260 

degrees 

29 

38 

degrees 

11 

16 

degrees 

345 

390 

knots 

4300 

4950 

f t/mi n . 

107 

262 

degrees 

20140 

20-40 

ft. 
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DESCENDING  TURN 


What  was  the  pitch  angle  when  the  nose  was  lowest? 


DT-33 

At  what 

head 

D  7-34 

What 

was 

the 

m-35 

What 

was 

the 

over 

for 

rrr-35 

What 

was 

the 

m-37 

What 

was 

the 

DT-38 

What 

was 

the 

DT-39 

What 

was 

the 

DT-40 

What 

was 

the 

Correct  Answers 


Question 

17 

DT-33 

216 

DT-34 

-1 

DT-35 

300 

DT-36 

293 

DT-37 

20000 

DT-38 

1  6520 

DT-39 

0 

DJ-40 

39L 

gilt  3 eg 

!..ent  Nu.aber 

18 

19 

167 

84 

-5 

-4 

295 

300 

300 

350 

20320 

1 98  9  C 

1 3360 

15230 

0 

0 

47R 

32  R 

20 

Unit 

262 

degrees 

-5 

degrees 

300 

knots 

315 

knots 

20000 

ft. 

15bl0 

ft. 

0 

degrees 

321 

degrees 
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APPENDIX  J:  TEST  CONDITIONS  AND  DATA 


D 


2) 


3) 


4 


J 


5) 


G) 


7) 


6) 


Pilot  A 

flight 

Maneuver 

Segment 

Display  Quest 

i  on 

Reported 

Indicated 

IT 

8 

CRT  10 

?* 

19,690  ft 

16 

245 

270  kt 

11 

20,000 

20,580  ft 

15 

285 

290  kt 

Correct  = 

1 

CT 

14 

CRT  29 

225 

270  kt 

28 

14 

19° 

30 

4,  COO 

4,000  ft/mi n 

25 

225 

255  kt 

Correct  = 

2 

DT 

18 

CRT  37 

20,000 

20,320  ft 

35 

300 

300  kt 

38 

15,000 

13,360  ft 

33 

165 

167° 

Correct  = 

3 

CT 

13 

inst.  30 

4,000 

3,050  ft/min 

28 

?* 

9° 

26 

115 

126° 

31 

1  or 

1  L.J 

10*70 

1  C  / 

Correct  = 

1 

LI 

5 

inst.  14 

280 

275  kt 

12 

131° 

10 

19,900 

19,810  ft 

15 

280 

280  kt 

Correct  - 

3 

D 

9 

inst.  22 

0 

0° 

20 

?* 

20,000  ft 

18 

310 

310  kt 

23 

0 

6" 

Correct  - 

3 

C 

1 

inst.  6 

0 

0° 

4 

5,000 

5,000  ft/min 

2 

19,900 

19,830  ft 

7 

20 

23° 

Correct  - 

3 

C 

4 

CRT  2 

19,900 

19,920  ft 

8 

none 

none 

3 

0 

1° 

7 

10 

12° 

Correct  = 

4 

*  Indicates  the  response  "I  don't  know." 
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Flight 

Maneuver  Segment  Display  Ques tjon  Deported  Indicated 


9) 

0 

12 

CRT  18 

300 

290  kt 

24 

6 

1 1  UR 

19 

325 

295  kt 

23 

0 

0° 

Correct  =  3 

10) 

D 

10 

CRT  21 

15,000 

15,100  ft 

20 

20,000 

20,220  ft 

22 

0 

0° 

17 

-7 

-7° 

Correct  =  4 

11) 

D 

11 

inst.  24 

3 

2° 

19 

300 

285  kt 

21 

15,500 

15,490  ft 

17 

?* 

-7° 

Correct  =  2 

12) 

DT 

20 

CRT  34 

-2 

-5° 

40 

25 

32° 

35 

300 

300  kt 

39 

0 

0° 

Correct  =  3 

13) 

DT 

19 

inst.  40 

29 

32° 

35 

300 

300  kt 

37 

20,000 

19,890  ft 

33 

?* 

84° 

Correct  --  3 

14) 

GI¬ 

IS 

inst.  32 

19,500 

20,140  ft 

27 

25 

29° 

29 

360 

345  kt 

25 

340 

335  kt 

Correct  =  2 

15) 

LT 

7 

inst.  16 

270 

265  kt 

11 

20,250 

20,100  ft 

13 

280 

270  kt 

9 

28-30 

28° 

Correct  =  4 

16) 

C 

0 

L. 

CRT  5 

615 

680  kt 

4 

5,800 

5,800  ft/r.i 

6 

0 

0° 

1 

?* 

19,830  ft 

Correct  -  2 


*  Indicates  the  response  "1  don't  know. 


ill'  11  tppg  MOW. I 


Flight 

Maneuver 

Segment 

Display  Question 

Reported 

Indicated 

CT 

16 

CRT 

26 

?* 

260° 

32 

19,800 

20,740  ft 

27 

33 

38° 

31 

260 

262° 

Correct 

=  2 

DT 

17 

inst. 

38 

16,500 

15,520  ft 

36 

300 

295  kt 

34 

?* 

-1° 

39 

6 

0° 

Correct 

=  3 

C 

3 

i  ns  t . 

8 

+4 

none 

3 

4 

0° 

1 

19,500 

19,600  ft. 

5 

370 

365  kt 

Correct 

=  4 

LT 

6 

CRT 

13 

245 

255  kt 

12 

176 

176° 

14 

250 

245  kt 

9 

29 

32° 

Correct 

=  4 

Pilot  S3 


Flight 


Maneuver 

Segment  . 

Display  Question 

Reported 

Indicated 

1) 

D 

11 

CRT  22 

0 

0° 

23 

4 

2° 

18 

390 

295  kt 

24 

4 

2° 

Correct  =  3 

2) 

LT 

6 

inst.  13 

280 

255  kt 

14 

280 

245  kt 

lb 

280 

260  kt 

10 

20,300 

20,030  ft 

Correct  -  1 

3) 

LT 

7 

CRT  14 

270 

270  kt 

15 

295 

295  kt 

10 

19,500 

19,710  ft 

16 

270 

265  kt 

Correct  -  4 

4) 

DT 

19 

CRT  33 

19,300 

15,230  ft 

39 

?* 

0° 

34 

-15 

-4° 

40 

25 

32° 

Correct  -  0 

5) 

D 

9 

CRT  19 

340 

315  kt 

21 

19,300 

15,370  ft 

17 

-1 

-1° 

20 

24,000 

20,000  ft 

Correct  =  1 

6) 

DT 

17 

CRT  35 

290 

3C0  kt 

37 

21 ,000 

20,000  ft 

33 

340 

216° 

■o  r 

OU 

295 

295  kt 

Correct  =  2 

7) 

C 

2 

inst.  5 

700 

680  kt 

0 

0 

0C 

7 

10 

29° 

2 

19,300 

20,010  ft 

Correct  =  1 

a) 

CT 

1C 

CRT  30 

?* 

4,300  ft, 

31 

100 

107° 

26 

80 

107° 

32 

18,000 

20,140  ft 

Correct  =  0 


*  Indicates  the  response  "Idon't  know." 
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Maneuver 


FI ight 

Segment  Display  Question  Reported  Indicated 


9) 


10) 


ID 


12) 


13) 


14) 


15) 


16) 


D 

10 

inst. 

21 

22 

23 

18 

Correct  =  2 

13,300 

0 

0 

380 

15,100  ft 

0° 

0° 

285  kts 

DT 

18 

inst, 

37 

38 

39 

34 

Correct  =  4 

20,000 

13,000 

0 

-5 

20,320  ft 
13,360  ft 

0° 

-5° 

LT 

8 

inst, 

16 

11 

12 

9 

Correct  =  2 

300 

20,300 

300 

31 

270  kt 
20,580  ft 

263° 

33° 

LT 

5 

CRT 

11 

13 

9 

12 

Correct  =  0 

24,000 

295 

15 

024 

20,400  ft 

280  kt 

34° 

131° 

L) 

12 

inst. 

24 

19 

20 

17 

Correct  =  3 

10 

320 

20,400 

-10 

ir  r 

295  kt 
20,240  ft 
-6° 

C 

4 

inst 

8 

3 

4 

1 

Correct  =  3 

none 

0 

4,000+ 

19,300 

none 

1° 

3,100  ft/mi n 
19,700  ft 

CT 

13 

CRT 

27 

29 

25 

28 

Correct  =  3 

44 

345 

330 

10 

40° 

350  kt 

345  kt 

9° 

C 

1 

CRT 

3 

5 

1 

4 

Correct  =  1 

0 

345 

13,000 

200 

0° 

360  kt 
19,670  ft 
5,800  ft/inin 

177 


FI  ight 

Maneuyev 

Segment. 

Dv.pl  fill0  -  J  U  ’ n 

Reported 

Indicated 

CT 

14 

inst.  29 

200 

270  kt 

30 

4,000  + 

4 , 000  f  t/rn  i  n 

31 

120 

122° 

26 

090 

122° 

Correct  =  3 

pt 

20 

inst.  40 

30 

32°  L 

35 

280 

300  kt 

36 

300 

315  kt 

p 

260 

262° 

Correc .  =  2 

c 

3 

CRT  6 

0 

0° 

7 

14 

15° 

2 

19,700 

19,940  ft 

8 

none 

none 

Correct  =  4 

CT 

16 

inst.  32 

20,600 

20,740  ft 

27 

32 

33° 

28 

10 

16  = 

25 

320 

400  kt 

Correct  -  1 

Pilot  C 


Flight 

Maneuver 

Sc  einent 

Display  Question 

Reported 

Indicated 

1) 

LT 

6 

CRT  14 

240 

245  kt 

15 

260 

260  kt 

16 

240 

235  kt 

10 

20,000 

20,030  ft 

Correct  =  4 

2) 

C 

3 

inst.  6 

0 

0° 

3 

0 

0° 

1 

20,000 

19,600  ft 

2 

20,000 

19,940  ft 

Correct  -  4 

3) 

DT 

17 

inst.  36 

300 

295  ft 

40 

35 

39° 

39 

0 

0° 

37 

20,000 

20,000  ft 

Correct  =  4 

4) 

CT 

16 

CRT  28 

16 

16° 

27 

26 

33° 

25 

390 

400  : . 

29 

330 

390  kt 

Correct  -  2 

b) 

C 

2 

CRT  6 

0 

0° 

7 

15 

29° 

8 

1 

none 

2 

19,990 

20,010  ft 

Correct  =  3 

6) 

LT 

7 

inst.  14 

300 

270  kt 

11 

20,000 

20,100  ft 

0 

25 

28° 

10 

19,600 

19,710  ft 

Correct  -  3 

7) 

CT 

15 

inst.  30 

2,000 

4,300  ft/mi n 

27 

30 

zr 

25 

340 

335  kt 

26 

80 

107° 

Correct  =  2 

8) 

DT 

19 

inst.  38 

16,000 

15,230  ft 

35 

300 

300  kt 

33 

80 

84° 

34 

V  • 

-4° 

Correct  =  2 

*  Indicates 

the  rcr.pon: 

o  "I  don't  know." 
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- -  f*  -  - 

'f 

FI  ight 

V  | 

'  I 

Maneuver 

Segment. 

Pi  splay  Question 

Reported 

Indicated 

9) 

DT 

20 

CR.  36 

300 

315  kt  ■ 

35 

300 

300  kt  : 

33 

250 

262°  ,* 

37 

20,000 

20,000  ft 

Correct  =  2 

10) 

D 

11 

inst.  22 

0 

0° 

19 

250 

285  kt 

17 

-10 

-7° 

i 

18 

300 

295  kt 

i 

Correct  =  3 

* 

i 

f 

!  11) 

D 

10 

CRT  22 

0 

0°  | 

23 

0 

0° 

18 

295 

285  kt 

24 

7 

0° 

Correct  =  3 

12) 

D 

12 

CRT  19 

350 

295  kt 

20 

20,000 

20,240  ft 

17 

-9 

-6° 

21 

15,000 

15,170  ft 

i 

Correct  -  3 

13) 

C 

4 

CRT  4 

2,000 

3,100  ft/mi n  Jj 

lu  \ 

3 

1 

i 

1 

20,000 

19,700  ft  1 

5 

350 

350  kt  1 

Correct  -  3 

j 

14) 

C 

1 

inst.  4 

5,000 

5,800  ft/mir.  1 

8 

none 

none  3 

7 

20 

23°  * 

5 

350 

360  kt  i 

Correct  -  3 

\> 
v^l 
*  ’) 

lb) 

D 

§ 

inst.  20 

20,000 

1 

on  r\r\r\  r  t.  m 

i  l.  | 

0°  i 

24 

0 

23 

0 

o°  5 

21 

15,500 

15,370  ft  I 

Correct  =  4 

! 

16) 

LT 

5 

inst.  12 

120 

1 31  °  j 

16 

280 

275  kt  J 

15 

280 

280  kt.  1 

13 

200 

280  kt  1 

Correct  =  3 

180 

j 

- *  *1  lVJ<  M  Ac!  t’v  .  .  jwi 

*  tv  .  il  .  . 

*  ..  , ...  ...  •  „ _ 

. . J 

17) 


18) 


19) 


20) 


Flight. 


Maneuver 

Segment 

Display  Question 

Reported 

Indicated 

CT 

13 

inst. 

28 

32 

31 

29 

Correct  =  4 

8 

19.700 

130 

350 

9° 

19,750  ft 
127° 

350  kt 

DT 

18 

CRT 

38 

39 

40 

34 

Correct  =  2 

15,500 

0 

26 

-4 

13,360  ft 

0° 

47°  R 
-5° 

CT 

14 

CRT 

30 

31 

32 

26 

Correct  =  2 

2,500 

122 

?* 

120 

4,009  f t/mi i 
122° 

19,800  ft 
122° 

IT 

8 

CRT 

12 

11 

9 

13 

Correct  =  3 

260 

20,500 

25 

280 

263° 

20,580  ft 

33° 

275  kt 

*  Indicates  the  response  "I  don't  know." 
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Pilot  D 


FI  ight 

Maneuver 

Segment  • 

Displ ay  Question 

Reported 

Indicated 

1) 

CT 

16 

inst.  31 

?*• 

262v 

26 

?* 

260° 

29 

300 

390  kt 

28 

10 

16° 

Correct 

=  0 

2) 

C 

3 

CRT  5 

355 

365  kt 

8 

none 

homo 

4 

5,800 

5,800  ft/mi n 

6 

0 

0° 

Correct 

=  4 

3) 

DT 

20 

inst.  '39 

3 

0° 

34 

-6 

-5° 

37 

19,000 

20,000  ft 

36 

300 

315  kt 

Correct 

=  2 

4) 

CT 

14 

inst.  32 

19,000 

19,800  ft 

25 

260 

255  kt 

27 

25 

27° 

30 

4,000 

4,000  ft/min 

Correct 

«  3 

5) 

C 

1 

CRT  3 

0 

0° 

1 

19,800 

19,670  ft 

2 

20,000 

19,830  ft 

7 

16 

23° 

Correct 

=  3 

6) 

CT 

13 

CRT  27 

40 

401 

25 

300 

345  kt 

26 

90 

126c 

31 

90 

127° 

Correct 

-  1 

7) 

C 

4 

inst.  7 

12 

12° 

2 

20,000 

19,920  ft 

5 

360 

350  kt 

4 

3,000 

3,100  ft/min 

Correct 

=  4 

8) 

D 

12 

inst.  23 

0 

0° 

18 

360 

290  kt 

21 

15,000 

15,170  ft 

20 

19,000 

20,240  ft 

Correct 

=  2 

*  Indicates 

the  respo.-r 

so  "I  don’t  hi' 

w." 

182 


FI ight 


Maneuver 

Segment 

Display  Question 

Rg^ortcd 

Indicated 

9) 

LT 

5 

CRT  11 

20,300 

20,400  ft 

9 

30 

34° 

10 

19,000 

19,810  ft 

15 

275 

275  kt 

Correct  = 

3 

10) 

LT 

8 

Inst.  15 

280 

290  kt 

10 

20,000 

19,690  ft 

13 

280 

275  kt 

12 

270 

263° 

Correct  = 

3 

ID 

DT 

18 

inst.  40 

45 

47° 

33 

140 

167° 

35 

300 

295  kt 

38 

13,000 

13,360  ft 

Correct  - 

3 

12) 

D 

10 

inst.  24 

0 

0° 

17 

-12 

-T 

19 

310 

300  kt 

22 

0 

0° 

Correct  = 

4 

13) 

CT 

15 

CRT  29 

350 

345  kt 

32 

15,000 

20,140  ft 

23 

8 

IT' 

30 

1,000 

4,300  ft/rni 

Correct  = 

2 

14) 

C 

2 

inst.  8 

none 

none 

1 

19,500 

19,830  ft 

3 

0 

0° 

6 

0 

0° 

Correct  - 

4 

1C) 

•  ^  J 

DT 

-  i 

1  t 

CRT  35 

300 

3UU  kt 

33 

190 

216° 

34 

-2 

-1° 

39 

0 

0° 

Correct 

3 

16) 

D 

9 

CRT  19 

310 

315  kt 

17 

-2 

-1° 

18 

300 

310  kt 

23 

0 

0" 

Correct  =  4 


10) 


.at  *>-■>» 


i 


Maneuver 

Flight 

Segment 

Display  Question 

Reported 

Indicated 

DT 

19 

CRT 

37 

40 

36 

38 

Correct  =  3 

19,900 

26 

360 

15,000 

19,890  ft 
32° 

350  kt 
15,230  ft 

LT 

7 

CRT 

13 

16 

12 

14 

Correct  =  4 

275 

270 

90 

275 

270  kt 
265  kt 
92° 

270  kt 

LT 

6 

inst. 

16 

9 

11 

14 

Correct  =  1 

260 

25 

20,500 

260 

235  kt 
32° 

20,950  ft 
245  kt 

D 

11 

CRT 

21 

24 

20 

22 

Correct  =  3 

17,000 

2 

20, .00 

0 

15,490  ft 

2° 

20,130  ft 
0° 

APPENDIX  K:  TEST  IP  BRIEFING 


You  are  being  asked  to  participate  in  a  test  which  is  being  developed 
for  future  evaluation  of  cockpit  displays.  In  the  present  instance,  we 
are  limiting  the  display  to  the  flight  performance  indications,  specifi¬ 
cally  a)  airspeed,  b)  airplane  pitch  and  bank  attitude,  c)  altitude, 
d)  vcM'tical  velocity,  and  e)  heading. 

You  will  see  two  types  of  displays,  standard  instruments  and  digital 
presen  La t ion  on  a  cathode  ray  tube.  These  have  not  been  chosen  because 
of  a  question  about  their  relative  effectiveness  but  because  of  their 
dissimilarity.  It's  rather  like  the  <i  i f Terence  between  a  It au i L ioual 
watch  with  dial  and, hands  and  the  new  digital  watches;  one  format  may  be 
good  in  one  situation  while  the  other  may  best  suit  another. 

It  is  important  that  you  know  that,  although  we  ask  you  to  work  sincer¬ 
ely  at  the  task,  we  are  not  testing  your  ability  but  rattier  the  effici¬ 
ency  of  our  approach  to  the  evaluation  of  displays.  Since  you  will  see 
both  types  of  displays,  we  can  compare  your  performance  with  one  type 
against  your  performance  with  the  Other  type.  Thus  wo  are  not  concerneu 
with  companions  between  your  performance  and  someone  else's,  only  with 
how  effc-ctiv?  is  our  approach  to  display  evaluation. 
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In  this,  the  initial  stage  of  research  in  this  area  -  information  dis¬ 
plays  at  an  instructor/opc rator  station  in  conjunction  with  flight 
simulator  training  -  some  artificialities  are  required.  For  example,  we 
will  ask  you  to  view  a  series  of  short  one  o^  two  minute  flight  segments 
without,  describing  the  maneuver  before  its  presentation.  The  infor¬ 
mation  presented  to  you  will  be  limited  to  that  mentioned  earlier; 
airspeed,  attitude,  altitude,  vertical  velocity,  arid  heading.  This  will 
be  shown  either  in  digital  form  on  a  cathode  ray  tube  or  on  standard 
instruments,  circular  dial  wi*h  pointer  except  for  the  attitude  indi¬ 
cator.  The  arrangement  will  be  standard  with  the  airspeed  on  the  left, 
attitude  indicator  in  the  middle  above  the  heading  indicator,  and  alti¬ 
tude  on  the  right  next  to  the  VV1.  The  digital  format  on  the  cathode- 
ray  tube  (located  above  the  standard  instruments,  which  will  be  covered 
during  the  cathode  ray  tube  presentations)  will  be  arranged  in  the  same 
manner  as  the  standard  instruments. 

After  each  flight  segment  presentation,  you  will  be  asr.ed  questions 
about  the  information  shewn  in  the  display.  These  questions  '..ill  be 
concerned  with  the  values  displayed  at  various  points  in  the  maneuver 
such  as  maximum  and  minimum  altitude,  attitude,  airspeed,  vertical 
velocity,  or  heading  at  various  points  in  the  maneuver.  You  are  being 
as(ked  to  remain  alert  to  all  of  the  five  instrument  indications  tlrough- 
out  the  short  flight  segment,  this  being  the  reason  for  your  not  being 
to"'d  about  the  maneuver  befot  ehand. 
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The  questions  hove  been  selected  to  represent  typical  student  errors  in 
flying  in  a  simulator  and  will  therefore  be  relevant  to  the  maneuver 
presented.  However,  since  you  will  not  be  told  about  the  maneuver  prior 
to  the  presentation,  the  questions  will  be  related  to  identifiable 
portions  of  it  such  as  beginning  airspeed  in  a  turn  or  altitude  at 
level-off  in  a  climb. 

This  research  is  being  conducted  as  part  of  an  Air  Force  contract  with 
the  Boeing  Company.  As  a  research  and  development  effort  conducted 
under  contract,  the  Air  Force  is,  of  course,  not  responsible  for  the 
specifics  of  this  test.  However,  the  Con, [.'any  has  obvious  interest  in 
its  success.  We,  therefore,  ask  you  to  do  your  best  in  the  task  in 
which  you  are  participating,  and  we  welcome  any  suggestions  you  may  have 
for  improving  the  quality  of  this  evaluation  technique. 
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